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CHAPTER OUTLINE 


E Theory of Computation | 


In theoretical computer science the theory of computation is the branch that deals with 
whether and how efficiently problems can be solved on a model of computation, using an 
algorithm. In order to perform a rigorous study of computation, computer scientists work 
with a mathematical abstraction of computers called a model of computation like Finite 
Automata, Turing machine, etc., Automata theory is the study of abstract machines (i.e., 
abstract mathematical machines) and the computational problems that can be solved using 
these machines. These abstract machines are called automata. 


1.1 


Set is a well defined collection of objects. Individual objects in the set are called members/ 
elements of the set. 

We use the capital letters A, B, C, . . . . for denoting the sets. The small letters а, b, c, .... are 
used to denote the elements of any set. When a is an element of the set А, we write a € A. 
When ais not an element of A. We write a € A. 


Set of even numbers greater than 0 and less than 10. 
A ={2, 4,6, 8} 


Set of vowels A = (a, e, i, o, и} 


Subset: Let A and B be two sets, if every element of set А is present in set B then А is called 
the subset of B, and is denoted by A © B. 


Example 


А = (a,b, c) 
B = {a, b, с, d, e} then A SB. 


Equal Set: Let A and B be two sets. They are called equal sets if both the sets have same 
members. 


Example 


A = {а b,c} 
В = а,Ь, c) then A=B 


Empty Setor Null Set (Ø): The set having no elements in it is called empty set. Itis denoted 
by 0 or {} 


tion to Finite Autom 


Power Set: Let A be the set. The set of all subsets of set A is called Power set of A and is 
denoted by 2^. 


A = (a,b, c) 
Power set, 2^ = ( Ø, (a), (b), (c), (a, b), (a, c) (b, c), (a, b, c) ) 
Operations on Set 
(i) Union (J): The Union of two sets A and В is given by AU В = (xIxeAorxe B 
i.e.) combination of both the sets. 


c, d, e) 

AUB -(a,b,c,d,e) 

(ii) Intersection (^): The Intersection of two sets A and В is given by 
AnBz-(xIx€ Aand x € B) (ie.) collection of common elements in both the sets 
A and B. 


Example : 


Let 


Difference 
The difference of two sets A and B is given byA- В = {x | x € A or x € B} 


Let 

= (a, b, c, d) 
c, d, e) 

а, b) 

ta 
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The word "automata" is used for recognizing. A machine understands a set of words, that 
is, it accepts a set of words and rejects some others. The study of such machines is known 
as automata theory. 

Symbol: Symbol is an abstract entity. 


Letters : а, Б, с, __ 
Digits : 0,1,2,__ 


Alphabet (3): An alphabet or character set is a finite non-empty set of symbols. 
Binary alphabets, Х = (0,1) 

English alphabets, £= {a, b, c,_____ z} 

String: A String or word is a finite sequence of symbols from the alphabet, £. 


Example : 


Let X -(0,1) 
The various strings that can be obtained from X are 
0, 1, 00, 01, 10, 11, 010, 101, 
Length of a String | $ | 
Length of a string is the total numbers of symbols in the string. 
Let 5 = 001 then, length of the string, | s | = 3 
Empty String (c): Empty string is a string of length zero. 


Concatenation 


If x and y are two strings, then the concatenation of x and y denoted by x · y is the string 
obtained by writing the symbols of string x followed by the symbols of string y. 


Let X 7 computer and y - science then, 
X:y = computer science 


Prefix of S: Prefix of 5 is any number of leading symbols of S. 
Let 5 -abcthen prefix of = €, a, ab, abc 


Suffix of S: Suffix of S is any number of trailing symbols of S. 


Let S =a bc then suffix of S = €, c, bc, abc 


Language: Language isa set of strings formed from some specific alphabet, X. The language, 
L is simply a subset of Z*, where X* denotes the set of all strings over X. 


Let E - (0, 1) then, the language, L = {0, 01, 0011, 0111} 
Where L consists of all the strings starting with zero. 


Let У = (a, b) then the language, L = (a" b" |m > 0} 
Where L consists of all the strings beginning with one or more a's followed by same number of b's. 
ie, = {E, ab, aabb, aaabbb, _____ } 


Concatenation (L.M) 


If L and M are languages, then the concatenation of L and M denoted by L.M is the language 
consisting of all the strings xy which can be formed by selecting a string of x from L and a 
string of y from M and concatenating them in that order. 


ie, L.M = {ху|х1$ т L and y is in М} 


Let L = (0,01, 110} and M = (10, 110) then L. M = {010, 0110, 01110, 11010, 110110} 


Union (L U M): If L and M are languages, then Union of L and M, denoted by L U M is the 
language consisting of the string x from L or the string x from M. 


Le.: LUM -(x|xisinLorxisin M} 
Let L = (0,01, 110) and M = (10, 110) then L U M = {0, 01, 10, 110} 


Kleen Closure (/*): Kleen closure of the language L, is the unary operation, L* of the 
anguage L. That is zero or more concatenations of L. 


b= Geb ULUL an 


Let, L = {0, 1} then L* = (e, 0, 1, 00, 01, 11, 10,000, _____ } 


Positive Closure (L’): Positive closure, L' is the same as L* but without empty string, €. 
That is one or more concatenations of L. 
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0, 1, 00, 01,11, 10, 000, __ 


Let L -(0,1)then 
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Finite automata is a mathematical model which is used to study the abstract machines or 
abstract computing devices with the inputs chosen from X. Where Х is the set of alphabets 
using which any string can be obtained. On reading the string, the machine may accept the 
string or reject the string. 


An abstract machine is a conceptual or theoretical model of a computer hardware or software 
system which really does not exist. 


Finite automata is an abstract model of a digital computer which has the following three 
components 

* Input tape e Control Unit апа * Output 

* Input Tape: The input tape is divided into cells each of which can hold one symbol. 

The string to be processed is stored in these cells. 

* Control Unit: Control unit has finite set of states. It has one start state and one or 
more final states. The state of the machine may change based on the current input 
symbol. 

Output: Output may be accept or reject. When end of the input is encountered the 
finite automata accepts the input string if it is a final state/accepting state, otherwise 
it rejects the input string. 


DII] 


Input Tape 


Output 
(Accept/ 
Reject) 


Control Unit 


Introductio 


itomata Йй 


Finite automata is a five tuple, (Q, X, 6, q,, F) 
Where Q is a non-empty finite set of states. 
Lis non-empty finite set of input symbols. 
q,€ Q is the start state. 
FC Q, is a set of accepting/final states. 
6:QXX — 0, isa transition function. 


For any symbol a € X and states qy q, € Q, 5 (q, a) = q, implies that the final automata 
moves from state q, to q, on receiving the input symbol a. 


Finite automata is represented using a transition diagram/labeled directed graph, where 
the nodes represents the states and the labeled edges represents the transition function. 


Notations used to represent a FA 
(i) Nodes are called states and each state is represented by a circle. 
(9) ‚Ч, is a state. 


(ii) The start state is represented using a circle with an arrow which is not originating 
from any node. 
0 ‚ q, İS a start state 


(iii) Final/Accepting state is denoted by double circle. 
q, is a final/accepting state 


(iv) The transitions are marked by arrow or directed line labelled with the input symbol, 
which starts from the current state and ends in the next state. 


@)-2+@). 6 QO =ч, 


Transition Diagram Transition Table 


5 а 
— (8-2 @) ma 
ô (qy a) 7 d *q,| 6 


— oY 


The transitions of a FA can also be represented using a transition table, in which there is а 
row for each state and a column for each input symbol. In the transition table the start state 
is marked with an arrow and the final/accepting state with a star. 
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FA is defined as 
M= (Q, Z, ô, qy F) 
Where, Q= (4,4, 4,4.) 
E- (a,b) 
4,7 49) 
F={q,} 


Any string using which we can traverse from the start state to the final state is said to be 
accepted by a finite automata. 


L(M) = {х5 (qy x) is in Р) 


Example 1 


Finite automata which accepts an input string 01. 


Finite automata which accepts an infinite number of 
0's followed by 01. 


peo 


Finite automata which accepts a 0 followed by 
any number of 1's. 


Q? 
CELO 


* Language Processing: The applications of finite automate are found in language 
processing such as string processing, parsing, morphological representations, 
information retrieval, tagging, stemming, image compressions etc., 

+ Compiler constructions: FA is used in the design of first phase of compiler (ie.,) 
Lexical Analyser, which breaks the input text into tokens such as identifiers, 
keywords, punctuations etc., 

* Computer Networks: FA is used in the design of communication protocols. For 
example, for a communication link. 


i Send packet If NO ACKNOWLEDGE 


e On then re send p" 


Receive Acknowledge 


Video Games: Games like Warcraft III, take advantage of complex FA to control 
artificial intelligence. A bot is a computer generated character in a video games. Chat 
dialogues where the user is prompted with choices can also be run using FA. 


. 


Design of Digital Circuits: FA is used during designing and checking the behaviour 
of digital circuits using software. FA is useful in the design of automatic traffic signals 
and circuit verification. 


Biomedical Problem Solving: Fourier transform Nuclear MagneticResonance (NMR) 
imaging, X-ray tomography, X-ray diffraction, differential scanning calorimetry and 
mass spectrometry are some of the techniques which employ FA. 


Cellular automata are used for making pretty pictures and animations. 


The different types of finite automata are 
* Deterministic finite Automata (DFA) 
* Non-Deterministic Finite Automata (NFA) 
* Non-Deterministic Finite Automata with € - moves (Е - NFA) 


DFA is a finite automata which can have only one transition from a state on an inputsymbol. 
That is for each state 'q' and input symbol 'a there is at most one edge labeled 'a' leaving 'q'. 
A DFA returns exactly one state after reading an input symbol. 


Definition: DFA is a five tuple (Q, X, 5, qy F) 
Where Q is a non-empty finite set of states 
X is a non-empty finite set of input symbols 
q, € Q, is the start state 
ЕС 0, 15 a set of accepting/final states 
6: 0ХХ — Q,isatransition function given by the mapping function QX X—0Q 
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Where | 
DFAisdefinedas D = (Q, £, 8, qy F) 
Q= (4,4) 
X-(0 1) 
I = 49) 
F= {q,} 


The extended transition function, 5* describes what happens to a state of machine when 
the input is a string. 


Let D =(0, X, 5,4, Е) bea DFA 

The extended transition function, 6* : Q X X* — Q is defined recursively as follows. 
Basis: 6*(q,€) =q 

That is the DFA stays in the same state '4', when it reads an empty string e. 

Let w = ха, 

Where ‘a’ is the last symbol of w and 'х' is the remaining string of w. 


Let 'q' be the current state and w be the string to be processed. After consuming the string 
w, let the state of the machine be 'p'. 


Then, 5* (а, м) = 6* (9, x a) 
=6* (6* (4, x) a) =p 
1. 6*(q, €) =q 
2. 6* (q, w) = 6* (q, x a) = 6 (5* (q, х), а), where w = x a 
3. 6* (q, w) = 6* (q, a x) = 6* (6 (q, а), x), where w=ax 


1.6.3 а! а‹ у FA 


Let D = (Q, Y, 6, q, F) bea DFA. A string wis accepted by the DFA D if it takes the initial state 
q, to final state ie., 5* (q,w) is in F. 


L(M) = (w|w € X* and 8* (q, w) is in F} 
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Show that the string 0011 is accepted by the following DFA 


To show the string 0011 is accepted by the DFA, we use the following moves: 


ая, 


Since we started from the start state 4, and successively traversed the states with the 
input string and reached the final state, the string 0011 is accepted by the DFA. 


Check whether the strings a a ba band baba is accepted by the following DFA. 


ЕЕ 


— — q —— 


| (i) For the string: a a b a b 
| Moves are as follows: q, -4 > q, ад Вы, а а, b > 0, 


Since we encountered the end of the input and we are in the final state, the string is 
accepted by the DFA. 


(ii) For the string: baba 
b b 


Moves are as follows: q, 2» q, > q, 259,954, 


Since we encountered the end of the input and q, is not the final state, the string is 
rejected by the DFA. 


Different types of problems for which we can construct a DFA are 
* Pattern recognition problems 


* Divisible by K problems 
* Modulo - K - counter problems. 


D 
КЕЙ Pattern Recog 


The general steps to be followed while designing the DFA are 
1. Identify the minimum string 
2. Identify the alphabets 
3. Construct a skeleton of DFA 
4. Identify other transitions which are not defined in step 3. 
5. Construct the DFA using transitions in step 3 and step 4. 


Draw a DFA to accept strings of a's having atleast one a. 


— — q 


Step 1: Identify the minimum string = a 
Step 2: Identify the alphabets, X - (a) 
Step 3: Construct the skeleton DFA. 


—@&)—“ (8) 
start 


Step 4: Identify the transitions not defined in Step 3. 


6 (9, а) =? 
Since after one a, апу number of a's can be accepted, the transition is 6 (q, a) = q, 
Step 5: Construct the DFA. 


The DFA is defined as 


Qa D= (Q, X, 5, 9» F) 

ЕО) а Where 0 = {9,9,) 8l a 
start accept У = {а} = a 
Transition Diagram 4,7 {9%} aal @ 

F= {9} Ae st 
PRoBLEM 4 


Design a DFA for strings that always ends with 01 where X = (0, 1) 


— — SEND — — 


Step 1: minimum string - 01 
Step 2: ХУ = (0,1) 
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Step 3: Skeleton DFA 


б (qy 1) = q, since the string can begin with any number 
of 1's 

6 (q,, 0) = q, since the string can have any number of 0's 
as the substring 

6 (q, 0) = q, since the string has to end with 01. 

б (q, 1) = q, since the string has to end with 01 


Step 5: Construct the DFA 
The DFA is defined as 
D = {0, 3,9, dy F} 


1 С? ' 
where Q= ( qy 4,4} 
1 q, = {93} 
F= {9} 


Design а DFA to accept the set of strings of 0 and 1 ending with 11. 


— — GEHE — — 


Step 1: minimum string = 11 
Step 2: Z-(0,1) 


Step 3: Skeleton DFA —> ye | 


Step 4: Identify the transitions not defined in Step 3 

б (ay 0) = q, The string can begin with any number of 0's 
6 (q, 0) = q, The string can have any number of 0's as 
substring but has to end with 11. 

5 (q, 0) = q, The string has to end with 11 

8 (9,, 1) = а, The string can have more than two 1's at the 
end. 
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Step 5: construct the DFA 
The DFA is defined as 


& CN D = {0, У, 5,4» F} 
1 1 where Q-(4,4,4;) 
осо. "m Diem 
I = {93} 
0 i F= {q,} 


Draw a DFA to accept strings of 0's and 1's ending with 101. 


— m» —— 


Step 1: Minimum string - 101 


Step2: X-(0,1) 
29:60:96] 


Step 3: Skeleton DFA 

Step 4: Identify the other undefined transitions. 

б (qy 0) = q, The string can begin with any number of 0's 
6 (q, 0) = q, The string has to end with 101. 

5 (q, 0) = q, The string can have any number of 0's as the 
substring. 

8 (q, 1) = q, Since 6 (q, 1) = q, and the sequence 101 is 
accepted. 

6 (q, 1) =q, The string has to end with 101. 


7. The DFA is defined as 
D ={0, У, 8, qy F} 
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Q = (99,993) 


Z ={ 0,1} 
q, = {95} 
Е ={q,} 


Draw а DFA to accept strings which end with 110 where X = (0,1) 


Step 1: Minimum string = 110 
Step 2: X = (0,1) 


Step 3: Skeleton DFA к=» 41, ig 0 | 


Step 4: Identify the other undefined transitions. 

8 (dy 0) = q, The string can begin with any number of 0's 
8 (q, 0) = q, The string can have any number of 0's as 
substring. 

8 (q, 1) = q, The sequence 110 is accepted 

5 (dẹ 1) = q, The string has to end with 110 

8 (qy 1) = q, The sequence 110 is accepted 


Step 5: Construct the DFA 


*. The DFA is defined as 
р = {0, У, 8,4» F} 
Q = (9,4, Ч» Is) 
У ={0, 1} 
do = 49) 
Е ={9;} 
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Draw a DFA to accept strings of a's and b's ending with abc. 


— — «ИИН —— — 


Step 1: minimum string abc 
Step 2: È = { a, b, c} 
Step 3: Skeleton DFA 


Step 4: Identify the other undefined transitions. 
8 (qy b) = q, string can begin with any number of b's 
8 (qy c) = q, string can begin with any number of c's 


6 (q, a) = q, string can have any number of a's as substring 
but should end with abc. 


6 (q, c) = q, string has to end with abc. 

5 (q, а) = q, string has to end with abc. 

8 (q, b) = q, string can have any number of b as substring. 
8 (4, a) = q, string has to end with abc 

6 (4,6) =9,] string can have any number of b or c or 
6(q,c)7 d combination of b and c as substring. 


Step 5: construct the DFA 


..DFA D is defined as = {0, Y, 6, q, F } 
Q= (d, Ч» d» 93} 
E-(abc) 
I = (4) 
F={q,} 
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Draw a DFA to accept strings of a's an b's ending with ab or ba. 


— — qD 


Step 1: Minimum string ab or ba 
Step 2: E- (a,b) 


Introduc 


Q0 9 
pr. ec 
БОС. 


Step 3: Skeleton РЕА 


Step 4: Skeleton DFA 

6 (q,, a) = q, string can have any number of a as substring but end 
with ab. 

5 (q,, а) = q, string can end with ba 

6 (q, b) = q, The sequence abb is not accepted, but abb followed by 
à is accepted as it ends with ba 

5 (qy b) = q, string can have any number of b as substring 


б (4,а)=4, The sequence baa is not accepted but baa followed 
by b is accepted as it ends with ab. 


8 (q,, b) = q, string can end with ab 


Step 5: Construct the DFA 


. DFA is defined as 
D ={Q, £, 8, qy F} 
Q= {ay Ч» 4, 4» 9. } 
X-(ab) 
4,7(q) 
F-(4,4,) 
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Trap State: A state for which there exists transitions to itself for all the input symbols 
chosen from X is called a trap state. 

Dead State: A trap state can be a non final state or a final state. A non final trap state is 
called dead state. 


A final state, which is a trap state. 


ED... b 9" Ко. d 


accept trap state/ accept 
dead state 


Draw a DFA to accept string of a's and b's ending with abb, and also show that the 
strings bbabb and aaabb are accepted by the DFA. 


— q —— — 


Step 1: minimum string abb 
Step2: У = {а,Ь}, 


Step 3: Skeleton DFA _+@) 4, @) he OTO) | 


Step 4: Identify other transitions 


6 (qy b) = q, The string can begin with any number of b's 


6 (q, a) = q, The string can have any number of a's as 
substring but has to end with abb 


6 (q, а) = q, The sequence aba must follow bb so as to end 
with abb 


б (q, a) = q, since the string has to end with abb 


6 (q, b) = q, The string can have any number o b's as 
substring. 


b а 
a (ib e) by 
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. DFA is defined as 
D = {0, £, 8, qy F} 
07(4,4,4,4,) 


X-(ab) 
4,7 (4) 
F={q,} 


Checking the acceptability of the string bbabb. 
The moves are as follows 


Since we where able to successfully traverse the string bbabb from the starting state, q, to 
the final state q,, the string is accepted by the DFA. 
Checking the acceptability of the string aaabb 
The moves are as follows 

%-@» а, > а, 5, 9,554,459, 
Since we could traverse the string aaabb from the starting state q, to the final state q, the 
string is accepted by the DFA. 


Draw a DFA to accept strings of a's and b's having exactly one a. 


— li —— — 


Step 1: Identify minimum string : a 
Step 2:2 = {а,Ь} 
Step 3: Skeleton DFA 


—> @)—4 > | 


Step 4: Identify other transitions. 5» Б)= q,string can begin with any number 
of a's 

6 (q, a)= q, q, is a trap state because almost 

one a is allowed in the string. 

б (q, b)= q, string can end with any number 

of b's 

ô (q, a)- q, q, isa trap state 

ô (q, b)- 9, 9, іѕ а trap state 


Step 5: Construct the DFA 


BO. gu a ai 


accept trap state 


*. DFA is defined as 
D = (0, £, 8, qy F} 
Q-(4,4,4,) 
E-(ab) 
4,7 (4,) 
F={q,} 


Obtain a DFA to accept strings of a's and b's with atmost two consecutive b's. 


Step 1: Minimum string : bb 
Step 2: У = {а,Ь} 
Step 3: Skeleton DFA 


2-9 


ô (qy а) = q, string beginning with any number of a's is 
accepted 

8 (q, a) = q, string with any number of a's as substring is 
accepted 

8 (q, а) = q, any number of a's can occur at any position 
in the string 

8 (4„ b) = q, q, is trap state as atmost two consecutive b's 
are allowed 

6 (qy а) = qy q, is a dead state 

8 (q, b) = qy q, is a dead state. 


Step 4: Identify other transitions 


Step 5: Construct the DFA 


Qs 
ты 


Qa " 
<), -@ —b > (8) 


a 
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*. DFA is defined as 
р = {0, >, 5, qy F} 
0={4„4„Ч„Ч,} 
X-(ab) 
4,7 (4) 
Е= {4,99} 


Draw a DFA to accept strings of a's and b's which do not end with abb. 


Step 1: L={a,b} 
Step 2: The skeleton DFA will be 


Since the DFA do not end with abb q, cannot be a final state. qy q, q, аге final states 
as the string can have zero or more number of a's and b's as the substring. 

Step 3: Identify the other transitions. 

5 (dy b) = а, the string can begin with any number of b's. 

ô (q, а) = q, string can have any number of a's as substring 

6 (q, a) = q, string can end with a or ab 

5 (q,, a) = q, string should not end with abb. 

5 (q, b) = qy Я, string should not end with abb 


Step 4: construct the DFA 


b 
-Q- 


*. DFA is defined as 
D ={Q, 2, 5, qy F} 
Q={ qy d, 0, 4) 
L={ab} 

9 = {qo} 
F-(4,4,4,) 
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Obtain a DFA to accept strings of a's and b's starting with the string ab. 


—— «ИӘ —— — 


Step 1: Minimum string : ab 
Step2:X-(a,b) 
Step 3: Skeleton DFA 


Step 4: Identify other transitions. 


6 (qy b) = q, q, is a dead state as the string has to begin 
with ab. 

8 (q, a) = q, string has to begin with ab 

8 (q, a) = q, string can have any number of a's as substring 
6 (q, b) = q, string can have any number of b as substring 
ô (а, a) = qy q, is a dead state 

8 (q, b) = qy q, is a dead state 


. DFA is defined as 
D = (0,2, 8, qy F} 
Q= {qo Ч» Ч» 13} 
L={a,b} 

4,7 (4) 
F={q,} 
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Obtain a DFA to accept strings of 0's and 1's starting with atleast two 0's and ending 
with atleast two 1's 


Step 1: Minimum string 0011 
Step 2: Х = {0,1} 
Step 3: Skeleton DFA 


Step 4: Identify other transitions 

6 (qy 1) = q, string has to begin with 00. Beginning the 
string with 1 leads to dead state. 

6 (q, 1) =q, string has to begin with 00. Beginning with 01 
is not accepted 

б (4„ 0) = q, string can have any number of 0's as substring 
ô (q, 0) = q, string has to begin with 11 


5 (q, 0) = q, string can have any number of 0's as substring 
and has to end with 11. 


ô (q, 1) = q, ending with more than two 1's are allowed ô 
(a; 0) = q; q; is a dead state 
6 (q; 1) =q, q, is a dead state 


. DFA is defined as 
D = (0,7, 8, qy F} 
Q= {ay 4,4» Ч» 4, 45} 
Z-(0,1) 
4,7 (4) 
F-(q,) 
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Draw a DFA that accepts strings of a's and b's having a substring aa. 


— q — — 


Step 1: Minimum string = аа 
Step 2: Identify alphabets У = (a, b) 


Step 3 : Skeleton DFA —> (06) —4—- @)—&4—(@) | 


Step 4: Identify other transitions 

6 (qy b) = q, string can begin with any number of b's 
8 (q, b) = q, string should have aa as substring 

6 (q, а) = q, string can end with any number of a's 
8 (q, b) =q, string can end with any number of b's 
Step (v) construct the DFA 


b ab 


. DFAis defined as 
D-(Q, £, 5,q,F) 
Q7(4,4,4,) 
E-(ab) 

4,7 (4,) 
F={q,} 


Construct a DFA that accepts the set of all strings with 3 consecutive 0's, where 


D={0,1} 


Step 1; Identify minimum string = 000 
Step 2:7 = {0,1} 


Step 3: Skeleton РЕА 
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Step 4: Identify other transitions 

6 (qy 1) = q, string can begin with any number of 1's 

ô (q, 1) = q, string should have 3 consecutive 0's 

6 (4„ 1) = q, string should have 3 consecutive 0's 

ô (q, 0) = q, string can end with any number of 0's 

5 (q; 1) = q, string can have any number of is at the end 


. DFA is defined as 
D = {0, £, 85, qp F} 


07(4,3,4,4,) 
2={0,1} 


4,7 (4) 
F={q,} 


Draw a DFA over alphabet X = { 0, 1 }, that contain set of strings of 0's and 1's which 
contain substring 0101. 


Step 1: Minimum string = 0101 
Step 2: L={0,1} 
Step 3: Skeleton DFA 


1 -(&)—2 -(&) 1 (@) 


б (qy 1) = q, string can begin with any number of 0's 

ô (q, 0) = q, string can have any number of 0's as substring 
8 (4„ 1) = а, string can have any number of 1's as substring 
6 (a, 0) = q, string can have any number of 0's as substring 
5 (4„ 0) = q, string can end with any number of 0's 

6 (q, 1) = q, string can end with any number of 1's 
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Step 5: Construct the DFA 


1 0 


0,1 
Q Q q 
E оста 


2. DFA is defined as 
D ={Q, 2, 8, qy F} 
Q= {qy Ч» 9» 9» 9, } 


®={0,1} 
9,= (4) 
F={q,} 


Design a DFA over alphabet > = ( 0, 1 ) that contains set of strings of 0's and 1's except 
those containing substring 001. 


Step 1:D={0,1} 


Step 2: The skeleton DFA will be 


Since the DFA do not accept substring 001, q, is a dead state. 
qy qy Ч, are final states as the string can have zero or more number of 0's and 1's. 


dead state 


Step 3: Identify other transitions 


5 0 1 6 (qy 1) = q, string can begin with any number of 1's 

= | 4 1 6 (q, 1) = q, string can have any number of 1's as substring 
*g. |G. 7 б (q, 0) = q, string can end with any number of 0's 
*q,| ? а, 5 (a, 0) = q, q, is a dead state 


q [T - 6 (qy 1) = q, 9,15 a dead state 


Step 4: Construct the DFA 


: 
D 


1 


7. DFA is defined as 


D = {Q, £, 8, qy F} 0 1 
Where ч, d, 
Q= (4, 4, 9» Is } а, 4, 
P2001] 9 4s 
4,7 (4) а, а, 
F-(4,4,4,) | 
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Construct a DFA to accept the set of all strings not containing the substring 00 for 
X2(0,1] and show the acceptability of the string, w = 101011 


Step 1: Minimum String - 0, 1 
Step 2: L={0,1} 
Step 3: Skeleton DFA 


for 0 - the skelton DFA for 0 or 1 is 


Step 4: Identify other transitions 


6|0 1 
d, 4, 4 


217 3? 

5 (4,0) =q, q,is a new dead state since the DFA should not accept the substring 00. 

6 (4,1) =q, q,is a new final state, since the DFA can accept the string 01. 
Undefined transitions from 4, 

5 (9,0) =q, since 4,15 a dead state 

5(4,1) =ч, 
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Undefined transitions from 4, 
5 (q, 0) = q, since it can accept the string 010. 
ô (q, 1) = q, since we can have any number of 1's at the end. 
Step 5: Construct the DFA 


(71 ^ aon 


^ DFA is defined as D = {Q, У, б, q,, F} 
Where Q7 {qy qy 4y» 43} 
X-(01) 
4,7(4,) 
F-(4,4,4,) 


Checking the acceptability of the string 101011. 


Moves are as follows 


1 0 


а 15 14,04, 1, q, 1, q, 


>q, 


Since q, is the final state, the string is accepted by the DFA. 


In Divisible by k problems, the string should be divisible by k. 
The steps to be followed to find DFA is shown below: 
Step 1: Identify the radix r, input alphabet J, and the devisor К. 
Step 2: Compute the possible remainders. These remainders represents the states of DFA. 
Step 3: Find the transitions using the relation ё ( q, a) = q, where j = (r * i + d) mod k 
г -radix of input. For binary r = 2. 
i - remainder obtained after dividing by k. 
d - digits. For binary d - (0, 1) 
k - divisor 
Step 4: Construct the DFA using the transitions obtained in step (iii) 


| Introduction to Fi 


— erm — — ——— 


Construct a DFA which accepts only those strings representing zero modulo Five. 
OR 
Draw a DFA to accept binary strings divisible by 5. 


— —— q 


The strings representing zero modulo five are 0000, 0101, 1010, 1111, etc. 
Step 1: Identify radix, input alphabets, and the divisor 

r =2,4= (0,1) К=5 
Step 2: Compute the possible remainders. 


i =0,1,2,3,4 
Step 3: Compute the transitions using the relation 8 (q, a) = q, where j = (r* i + d) mod k. 

Remainder d (2*i+d) mod 5 =] 5 (4,9) 7 q, 
"T 0 (2*0+0) mod 5=0 5 (4,0) = q, 

1 (2*0*1)mod5-1 5 (9,1) =9, 

m 0 (2*1+0) mod5 -2 8 (q,, 0) =4, 

1 (2*1*1)mod5-3 5 (9,1) - q, 

ои 0 (2*2+0)mod5=4 5 (0,0) =а, 

1 (2*2*1)mod5-0 8 (q,, 1) - q, 

Mr. 0 (2*3+0) шоа 5 =1 5 (4,0) 7 q, 

1 (2*3 + 1) mod5-2 5 (9,,1)=% 

тей 0 (2*4+0) mod 5=3 5 (9,0) =4, 

1 (2*4+ 1) тод5 =4 5 (q, 1) =9, 


*. The DFA can be defined as 
D =(Q, 2,8, qy Е) 
0 ={ dy ly 4» Vy 9, } 


X ={0,1} 
q, *(4,) 
Е -(q,) 


Draw a DFA to accept decimal strings divisible by 3. 


Step 1: Identify radix, Input alphabets and divisor. 
г =10d={0,1,2,3,4,5,6,7,8,9} 
k 23 

Step 2: Compute possible remainders 
i = 0,1,2 

Step 3: Compute transitions 

ô (q, d) = q, where j= (r*i* d) mod К. 
Нее j =(10*i+d)mod3 


0 | (10*0+0) mod б (9, = 6 (qy (0, 3, 6,9} ) =, 
i20 1 | (10*0+1) тодЗ=1 | 5(q,1)7q, |= 5 (9, (L4 7)) * q, 
2 | (10*0+2) тоаз=2 | &(q,2)=4, |= 8 (qy {2,5,8} ) = 
0 | (10*1+0) тоаз=1 | 5(9,0)=а, |> 5 (9,, {0,3,6,9} ) qd 
i21 1 | (10*1+1)mod3=2 | 8(q,1)74, = ô (q, {1,4,7}) =4, 
2 | (10*1+2)mod3=0 | 5(4,2)=9, = ô (q, {2, 5, 8}) 7 q, 
0 | (10*2+0)mod3=2 | 6(q,,0)=q, = 6 (q, (0,3, 6, 9}) =q, 
i=2 1 | (10*2+1)mod3=0 | 6(q,1)7q, = ô (q, {1, 4,7} ) =4, 
2 | (10*2+2)mod3=1 5(4,2)=4, | 5 (q, {2,5,8}) =4, 


Introduction to Finite Automa 


Step 5: Construct the DFA 
W369 L7 


The DFA can be defined as 


Where 
ie E, ô, qy F) 5 | {0, 3, 6, 9} | {1, 4, 7} | {2,5,8} 
={qy 4p 4} —"4 9 4, 9, 
: -(0,1,2,3,4,5,6,7,8,9) 4, ГА 9, % 
9, = {ao} ГА ГА 9 d; 
Е ={4} 
ЖЕЙ Modulo К Counter Problem _ 
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Draw a DFA to accept strings of even number of a's 


— «лар — — 


Step 1:2 = {а} 
Step 2: Identify the states 
Since the string may have even number of a's or odd number of a's, the DFA can 
have two states. 
(a) Even number of a's denoted by (E) 
| (b) Odd number of a's denoted by (0) 
| Step 3: Identify start state 
Before reading any input, the number of a's will be zero which represents Even a's 
so (E) is the starting state. 
q, (E) 
| Step 4: Identify final state 
Since the string should have even number of a’ s, (E)is the final state. 


F ={Е} 
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Step 5: Identify transitions 
ô (Е, а) = О reading a's from Even state leads to odd state 
ô (0, a) = E reading a's from Odd state leads to even state 
Step 6: Construct the DFA 


-. DFA is defined as 


а р = (0, £, 5,4„Е) 6 a 
Q-(EO) —*E| O 
== 5 E-(a) 
a J О| E 
q,7 (E) 
Е={Е} 
Рвовием 25 


Obtain a DFA to accept strings of a's and b's having even number of a's and even 
number of b's. 
— q —— — 
Step 1:2 ={a,b} 
Step 2: Identify the states 
Let q, -represents even number of a's and even number of b's. 
q, -represents even number of a's and odd number of b's 
q, -represents odd number of a's and even number of b's 
q, - represents odd number of a's and odd number of b's 
Step 3:4, = (q,) 
Step 4: F={q,} 


Step 5: Identify transitions 
Reading input from even state leads to odd state and vice versa, the transitions are 


6 (qa) =9, 5 (4, b) =4, 
ô (q,a) =4, 8 (9,0) - q, 
§@,a) =q, 5 (a, b) =q, 


Step 4: Construct the DFA 

-. DFA is defined as 
D - (Q,2,8,q, F) 
Q-7(4, 4,4, 4,) 
E={a,b} 
% = {4} 
F-(q) 
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Obtain a DFA to accept strings of a's and b's having odd number of a's and odd number 


of b's. 


Step 1: ХУ = {а,Ь} 
Step 2: Identify the states 
Let q, - represents even number of a's and even number of b's. 
q, -represents even number of a's and odd number of b's 
q, -represents odd number of a's and even number of b's 
q, -represents odd number of a's and odd number b's 
Step 3: 4, = (4) 
Step 4: Е = {q,} 
Step 5: Identify transitions 
Reading input from even states leads to odd state and vice versa, the transitions 


are 
ô (qva) =ч, 5 (9, b) =9, 5 (4, а) = 4; 
5 (4,6) =q 6 (q,, a) =9, 5 (4, b) =q, 


Step 6: Construct the DFA 


DFA is defined as 
D = (Q, £, 5,9, Е) 
0 = { Ч, 9,› 4,4.) 
Х= {а,Ь} 
4,7 (4,) 
F={q,} 
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Obtain DFA to accept strings whose length is multiple of оп X = (a,b) 


(i.e) L 


Step 1: 
Step 2: 


Step 3: 
Step 4: 
Step 5: 


={w||w|mod3=0} 


— — q ——— 


X-(ab) 
Identify the states 
Since the length of the string should be divisible by 3, let the states be 
9, - represents remainder 0. 
q, -represents remainder 1. 
q, - represents remainder 2. 


4,-(4,) 

F-{q.} 

Identify transitions 
ô (qy a) = q, $ (q, b) - q, 5 (4,3) =q, 
б (4,0) =ч, 6 (4а) =9, 8 (4,0) - q, 


Construct the DFA 


OO e 


a,b 


DFA is defined as 

D -(Q2,8,q,F) 
Q -(4,4,4;) 

Y ={46} q,-(q) 
Е -(q,) 
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EE 


If an automata makes more than one transition for a single input symbol from a single 
state, then the next state of the automata becomes unpredictable. Such type of automata is 
said to be NFA. If the finite automata is modified in such a way, that from a state on an input 
symbol, zero or more transitions are permitted, then the corresponding finite automata is 
called a NFA. 


For example, consider the following finite automata 


If the automation is in state q, and the input symbol is 0, 
what will be the next state? From the figure it is clear that 
the next state will be either q, or q,. Thus some moves of 
the machine cannot be determined uniquely by the input 
symbol from the present state, such machines are called 
NFA. 


n: NFA is a five tuple, (Q, У, 5,9, Е) 
Where Q is a non-empty finite set of states. 
У is a non-empty finite set of input symbols. 
q, € Q, is the start state 
ЕС Q, is the set of accepting/final states 
5: ОХХ — 2% is the transition function. 
29 is the power set of О, which is the set of all subsets of Q. 


p и 
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This NFA is defined as 

М= (Q, £, 5, qy F) 5 

Where — Q* {4 411 Iv Vy 9,} 
E={0,1} 


(4) (04) 


5 d, 0 (4) 
%5 {aa} % |(444) ih} 
F={q,} a | (4) 0 

"q | (au) ta) 


The moves made Бу the above NFA for the string 0100 is as follows 


9 0 >l 1 > 0, 0 > 4% а > q, Not Final State [.. Reject] 


mo. Ix, ^c iu Not Final State [^ Reject] 


по moves, по moves, 
[+ reject] [> reject] 4, Final State [^ Accept] 


The moves, 


4 вы 9, PT 9, A. q, 9. q, is accepted, since q, is the final state. 
11 
| 


EEA NFA Design 
Language accepted by a NFA 
Let N = (0, Z, 8, q, Р) be a NFA. A string w is accepted by the machine N, if it takes the initia 
state 'q,' to final state. i.e., 5* (q, w) is in F. 

L (N) ={w|w € Z* and 5* (q, w) isin F 


а о 


Draw МЕА to accept strings of a's and b's ending with ab. Check whether the strings 
abaab and abb is accepted by the NFA. 


NFA is defined as 6 1$ shown by transition table 
N- (02,5, F) 5 | а b 
Where Q= {qy 4, 9, } {а} 
E-(ab) 
q,7 (4) aj 9 {a} 


Е={9,} "« 9 0 
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(i) Forthe string abaab, the moves are as follows. 


d, oa, b 


> 4,—@—»> а„—@—>» q, by. 4, Not Final State 
2 pe- [> Reject] 
9, ——. 9, 9, % 


no moves, [Reject] 
[+ Reject] 


q, Final State [. Accept] 


The moves, q, L> q> q L> 9,95 9,0 4, is accepted, since q, is the final 
state. 


(ii) For the string abb the moves are as follows 
а —2—> q,—? > q, 2 > q, Not Final State [2 Reject] 
а 


9, Ebr [reject] 


The string abb is rejected by the NFA, since q, is not a final state. 


Design an NFA that accepts a set of all strings ending in 00 and check whether the 
string 100 is accepted by the NFA. 


и — 


1 
qi "Wn e 
6 о-о 
The NFA, М = (Q, £, 8,9, Е) 
Where Q = {9,,9,,9,) 5 о : 
EE (4) {ч„} 
4, 7 (4) die T 


F-(4) {a} Ø 


omputation 


For the string 100 the moves are as follows. 


а, 1-4,-0 q, D. q, [Final state -. accept] 


The string 100 is accepted, since q, is the final state. 


Design a NFA to recognize the following set of strings abc, abd and aacd. 


— — q ——— 
ub _, MES 

E. 
мо 
(8) —°—>@—@—@) 


> 
„әй 
The NFA, 


№= (0,5, 8,4, Е) 
Where Q = {qy d, 9 d Ч» 95, 9, 9 d do; 90) 


E-(abcd) 
q,7(4,) 
F={qy qo lo} 
6 a b с а 
4q|í(q,4,4,) 0 @ 0 
qd, @ {а} 0 o 
9, 0 Ø {4} 9 
*q, 6 6 0 6 
а, 6 {a} о © 
ГА 0 9 0 (aj 
К? @ оо © 
9) (4) о 0 0 
А @ 9 {a} Ø 
ГА 0 9 Ø (a 
*Ч Г) 9 0 0 
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Obtain a NFA to accept the following language. L = { w|w є abab" or aba" where n 2 0} 


— —— 


O5 
оо ^ 9-0) 
ИЧА oy" 


The NFA N = (Q, £, 5,9, Ё) 5 is shown using the transition table 
Where Q-(q,4, 0,0, 0, d.) 6 a b 
c: (qq) © 


GW = (4) а, ó (4) 

Fronde q| {a} 9 
*.| 9 (4, 
а, 9 (43 
*q,| {45} 0 


Design а NFA to accept all the strings over the alphabet ( 0, 1 } ending with 010. 


The NFA, М = (0, У, 5,9, Е) 6 is shown using the transition table. 
Where Q -(q, 4,4, 43} 5 0 1 
Prev) (4,4) (4) 
Qe «| 9 04) 
uto «| (4) 9 
*q, 9 6 
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Construct a NFA that accepts the set of all strings over (0, 1) that starts with 0 or 1 
and ends with 01 or 10. 


The NFA N = (Q, £, 6, q Е) 6 is shown using the transition table. 
Where Q = {4,,9,,9,,9;) 5 0 1 
H ETEEN (4,4) (4,4) 
Ч, 7 (a) а, 6 ta} 
F=(a} a| {45} 9 
ч 9 0 


ШШЕ Construction of DFA from NFA 

Let N = (Q,, È, 6,, qs; Fy) be a NFA, which accepts the language L (М). Then there exists an 

equivalent DFA, D = (Qy У, 6» qy Fp) such that L (№ = L (D). 

Conversion of NFA to DFA can be done using subset construction or Lazy evaluation 

method. In subset construction method, if the NFA has n states then the transitions for all 

the 2” states has to be found. Often all these states are not accessible from the start state of 

D. Inaccessible states can be thrown away. So effectively the number of states of D may be 

much smaller than 2". Hence the time complexity to convert NFA to DFA is Y X 2". The time 

complexity is exponential and the procedure takes long time. In order to avoid this we go 

for lazy evaluation method. In this method the transitions for all 2^ states are not found. 

Instead for each new state generated the corresponding transitions are found. 

The steps to convert an NFA to DFA are as follows. 

Step 1: The start state of NFA, is the start state of DFA. So add q, (which is the start stat of 
N) to Q, and find the transitions from this state. 

Step 2: For each state {q,, q» qy ----- q, } in Q, the transitions for each input symbol in У 
can be obtained as follows. 


(а) 5, ((4, 4„ y -- 9}, а) = 6, (а, а) U 6, (а, а) U- --6,(4,a) = (4, 4, --- 9, } 


(b) Add the state (qq, ----- q, ) to Qy if it is not already іп Q, repeat step 2. 
(c) If no new states are generated then stop. 


Step 3: The state (q, qy ----- q, ) which belongs to Q, is the final state, if atleast one of 
the state in qq, ----- q, is a final state of NFA. 


— — arm 


Convert the following NFA into an equivalent DFA 


mei 
Ш@ © „< 


The given NFA, М = (Qy È, 8, Ч» Fy) 5, 0 1 

Where Q, -(q9, 4, 4;) Е 
E ={0,1} {4} 
4, 7 4, «| 9 (4) 
F, -(4,) "« 9 А 


The equivalent DFA, D = (Qy E, ё, 9, Fy) 
r={0,1} 
Step 1: q, is the start state of DFA, since q, is the start state of NFA. г. Q, = {q, } 
Step 2: Obtain the corresponding transitions for each state in Q, on all input symbols. 
If there are any new states add it to Q, and find the transitions. 
5, from q, on X 
5, (4, 0) = 5, (q, 0) 
= (4,9) 
5, (4,1) = б, Gu 1) - (4) 
Now we have found out a new state г. find 5, from this new state. { qy q, 
ô, from {qp q,) on X 
8, (49, },0) = 5, (4,0) U 5, (q,, 0) 
| = (4,q,) UO 
7(4,4,) 
5094,5 D = 8, (a, 1) U 5, (ay 1) 
={9,} 9 {4} 
7(4,4)) 


o рта 


Again we have found a new state ( q,, 9, } 
8, from (q,, 9, } on X 
5,09, 42} 0) = 6, (9, 0) U 8, (4, 0) 
= {4,9} 96 
= (4,9) 
5,099, 1) = 9, Gy 1) U б, (4„ 1) 
-(q)UO 
={q} 
No more new states therefore we stop. 
Step 3: The final state, F, is the states in Q, which has q, [which is the final state of F,] 


Е, ={do Qh 
The equivalent DFA 8, | 0 1 
D = (Qy 25) I Fo) = (4) taya) {4} 


Where О, = ( {doh (a, d, 4492) } ай! ubt Y (6:4) 
v 11 o ti о 12 


X = {0, 1} 

q, = % * (4,4) |1991 {9} 
Е, -(4,4,) 

ME. 


The transition tab! 


The equivalent DFA 


Convert the following NFA to its equivalent DFA 


су C» 
091 у\ 01 | 
—@) 5 O (82 


The given NFA, N = (Qy E, 6, qy Fy) 5, 0 1 
p Oy = (Mor GMa} (44) (4) 
2 =(0,1 
à : } *q,| {ч} {4} 
о = Чо Ф 
Е, ={q,} 4; (4, 


The equivalent DFA, D = (Qy È, y 9, Fp) 
E-(01) 
Step 1: q, = { q,), 9,15 the start state of DFA, D. 
Step 2: 6, from q, on X 
8, (4, 0) = 5, Go 0) 
= 44,9) 
5, (Qo 1) = б, Go 1) 
={9,} 
5, from {qy q,)onX 
5, ({ 4, 4,},0) = 8, (9, 0) 6, (4,0) 
= (4, 4)) (9) 
7(4,4,4;) 
5, (( 4„4,}, 1) = б„ (q, DY Sy (а, 1) 
-(q)v(9) 
7(4,4) 
5, from {q,} on X 
5, ({9,},0) = 8, (9,0) 
={q,} 
5, ({4,}, 1) = 8, (а, D 
={q,} 


5, from (q, q,, q, ) on X 

5, ({ ao 442}: 0) = 5, (9, 0) U8, (q,, 0) о 5, (9,, 0) 
7(4,4) (4) 9 
= {ly Iv 4,) 

6, ((qy Iv 02} 1) = б„ Go 1) Y 8, (q, 1) 5, (4„ 1) 
= {4} Y 49.) (4) 
= 44,,9,) 

6, from (q,, а, ) on X 

5, (£4, 4,3, 0) = 8, (д, 0) \ 8, (4„ 0) 


={4)00 
-(4) 
5, ({ 4„4,},1) = 8, (q, 1) Y Sy (4„ 1) 
= {9,} Y {9,} 
= {9,} 
5, from {q,} on £ 
5, ((4,}, 0) = 8, (а» 0) 
=ø 
5, la} 0 = 8, (4„ 1) 
= 44) 


Step 3: The final state Е, = ( {qy q,), {9, } (Gy Gab (4, Gt } 
The equivalent DFA D = (Q,, 2, 8,, dy Fo) 
Where, Q, = ( {9,), (a, 4, } 49, {o Gy» 42} (a, 9. ), (4) ) 


E ={0,1} 
4 * d, 
Е, = { {4, 4, } (a, (a) Ч» 4), (4,,4,)) 
5, | о й 
= {q} (4,4) (4) 
*(q»4)  |(454,4,) (4,4) 
*(a (4,) (4, 
*(45454,) |(4, 4,4) {ayaz} 
*(4,4,) (4, (4) 


(4) 9 (4, 
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After renaming the states the transition table is as follows 
The equivalent DFA 


PRoaLEM 3 


Convert the following NFA to equivalent DFA. 


ШЕ. о.о 


The given МЕА N = (Qy X, 8, qy Fy) S| a b 
Where Q, ={A,B,C, D} 

— A| {A,B A 

X ={a,b} CAA 

4, =A ITAL 

F, ={D} c| 9 {D} 

*D| 9 0 
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The equivalent DFA D = (Q E, ôy qy Fp) 


E={0,1} 


Step 1: q,={A} 


Step 2: 5, 


from (AJ onX 


5, (A, d) = б, (A, a) = {A,B} 
5, (A,b) 28, (А, b) = (A) 


5, 
5, 


5, 
5, 


б, 


from { A, B) on X 

(КА, В}, a) = 6, (A, a) Y 5, (В, a) 
={А,В} чб 
={А,В} 

{ A, В), b) = 5, (A, b) \ б, (B, b) 
={A}U{C} 
={A,C} 

from { А, C) on X 

A, C}, a) = $, (A, a) v &, (C, a) 


-(Aj)yu(D] 


from (A4, D) onX 

A, D), a) = 5, (A, a) U8, (D, a) 
={А,В} об 
={A,B} 

({A, D}, b) = 8, (A, b) U6, (D, b) 

={А}о@ 

={A} 


Step 3: The final state 


F, ={{A, D}} 


The equivalent DFA. 


D = (0, È, 5, dy Fp) 


Where 


0, ={{A} {A,B}, {A,C}{A,D}} 


X -(ab) 
4 ={А} 
Е, -(AD) 


{A,B} (Aj 
{А,В} (AC) 
{A,B} {A,D} 
{A,B} {A} 
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Convert the given NFA to an equivalent DFA. 


L8. 6-0 


—— «ШИН» —— — 


The given NFA, N = (Qy, Х, 8,, Ч» Fy) 6, a b 
Where Q, ={A,B,C} pw 
N > {А} (B) 
E = {а,Ь} & 
a -(A) B| (B) (C) 
Е, ={B,C} * Ci {С} 9 


The equivalent DFA D = (Qy Y, ôy 4y F,) 
L={a,b} 
Step 1: q,={A} 
Step 2: 8, from Aon 
5, (А,а) -&,(A, a) - (A) 
5, (A, b) 26, (A, b) - (B) 
ô, from В on > 
8, (В,а) = ô, (В,а) - (B) 
5, (B, b) = ô, (B, b) ={C} 


8, from {C}on £ 
5, (C, a) = ô, (C, a) 
={C} 


5, (C, b) = ô, (C, b) 
=@ 


Step 3: The final state 
Е, = (В, С} 
The equivalent DFA 
D 7 (Qy У, 8, dy Fp) 
Where 
Q, = {A,B,C} 


es | DFA and NFA are the ваше. 


Convert the following NFA to DFA. 


The equivalent DFA 
D = (Qy E, 8, dy Fp) 
X ={ 0,1} 

Step 1: q,- P 


Step 2: 5, from (P) onX 
5, (Р,0) -& (P0) - (P.Q) 
5, (P, 1) =6, (P, 1) - (P) 
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5, from (P, Q } on € 

8, {PQ}, 0) = 6, (P, 0) Y 6, (0, 0) 
={P,Q}U{R} 
={P,Q,R} 

5, (CP, Q}, 1) 8, (P, 1) Y 8, (0, 1) 

={P}U{R} 
={P,R} 

ô, from { P,Q, R } on £ 

5, {PB @ R}, 0) =5, (P, 0) US, (0,0) Y 6, (R, 0) 
z-(EQ)uo(R)U(S) 
={P,@R,S} 

5, (CP, @ R}, 1) = б, (P, 1) U б, (9,1) Y 8, (R, 1) 
={P}U{R}UO 
-(BR) 

5, from (P, R) оп У, 

8, ({ P, R}, 0) = 5, (P, 0) US, (К, 0) 

={P Q}U{S} 
={P,QS} 

8, P, R}, 1) = 6, (Р, 1) v 6, (R, D 

={Р} об 
={P} 

6, from (P, Q, В, $} оп у, 

8, ({ P, Q, R, S}, 0) = 8, (P, 0) UG, (0, 0) U5, (R, 0) Y ôy (S, 0) 
={PQ}U{RJU{S} {5S} 
={P.QRS} 

5, ({ P, Q, R, S}, 1) = 6, (Р, 1) Y 6, (0, 1) Y &, (R, 1) 55, (5, 1) 
={Р} {8} 200({5} 
={P,RS} 

6, from { P,Q, S) on, 

5, (P. 0, 5), 0) = 8, (P,0) US, (Q, 0) US, (S, 0) 
={P.Q}U{R}U{S} 
z(BQRS) 

6, (2 0,5}, 1) 5, (Р, 1) Y 6, (0, 1) Y 8, (5, 1) 
={P}U{R}U{S} 


={P,R,S} 


6, from (P, В, S) оп У, 
5, ({ P, R, S }, 0) =5, (P, 0) об, (А, 0) U8, (5,0) 
={P.Q}U{S}U{S} 
={P,Q5} 
6 (CP, R, S}, 1) = 6, (P, 1) v 6, (В, 1) v 6, (S, 1) 
={P}UGU{S} 
={Р5} 
6, from (P, S] оп У, 
6, ((P, S), 0) = 6, (P, 0) чё, (S, 0) 
={PQ}U{S} 
={Р 0,5} 
5, ({P, S}, 1) = б, (Р, 1) об, (S, 1) 
={P}Uu{S} 
={Р5} 
Step 3: The final state 
Е, ={(Р,0,8,5), {P,Q S} {Р В,5), {2/5} 
The equivalent DFA 
D = (Qy E 8, 4y Fp) 
Where Q, ={{Р}, {20} {РОК} (CER, {P,Q R, S}, {20.5} (Р ,5) (Р, 5)) 


У ={0,1} 
q, ={Р} 
Е, ={{Р QR, S} {P 0,5} {РЕ,5},{Р5} 
5, 0 1 
iP) {PQ} (P) 


{PQ} {PQR} {PR} 
{PQR} | {PQR S} {РЕ} 

(ER) {PQS} {Р} 
HPQRS}| {PQRS} {PRS} 
{205} |{РОВ5} {PRS} 


*(BRS) {PQS} {PS} 


{85} {EQS} {BS} 
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PnosLEM 6 


Convert the following NFA to DFA 


-6— 8 ў 
— q ——— 


The given NFA, М = (Qy Y, б, Ч» Fy) 


Where Q, ={qy4,} б, 0 1 
={0,1} {9} 
q, ={4} 4,| {9,} 
Fy *(4,) ў 


The equivalent DFA D = (Qy 2, б„ 4y Fp) 
X ={0,1} 


asi Theory of Computation 


Step 1: q,- (4,) 
Step 2: 6, тот { 4, } onX 
5, (q, 0) = 5, (4„ 0) 
={4} 
б, Qo 1) = б, (9,1) 
={q,} 
5, from { 4, }}on = 
5, (4„ 0) = 5, (4„ 0) 
={4,} 
5, (q, 1) = б, (q, 1) 
={4» 9, } 
5, from { 9,9, } onX 
5, (44 Ib 0) = ôy (Ao 0) Y 8, (9,, 0) 
={q}U{a} 
= {49} 
5, ((q, 4), 1) = 5, (a, 1) Y 6, (a, 1) 
7(q)v(4,4) 
7(4,4) 
Step 3: The final state Е, = { {9,), (4, 4,}} 


The equivalent DFA, 5, 0 1 
D = (0, Y, 8, q, Fp) 
X (01) * (aq) («) (4) 
4, (4) (3| (a) {9,9} 


F, =4(4,,(4,9)) 
кү tes Ча„а,}|Са„а,) (44) 
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Find a DFA equivalent to the following, М = (£4, 4, а, }, Ca, b), 8, qy (q,) 
Where 8 is defined as follows: 


6, a b 
(4,4) (4) 
4| {9%} {9} 


* {49,) 


The equivalent ОЕА 
D = (0, E, ôy dy Fy) 
Where У -(ab) 
Step 1: 4,7 (q,) 
Step 2: 8, from { q, } onX 
5, (y a) = б, (9, a) 
={ 4» 9, } 
5, (9, b) =5, (q,, b) 
={9,} 
ô, from { q, q,} on X 
5, (ay q,) а) = 8, (dy a) U8, (q,, a) 
= {49.9} V (4,) 
7(4,4,) 
5, C (ay q,), b) = 8, (dy, b) об, (q,, b) 
-7(6)o(4) 
7(4,4,) 
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5, from ( q,) on X 
5, (dy а) = 6, (Qy a) 
=0 
5, ( q,, b) = б, (q,, b) 
= (99) 
6, from { Ч» q,) on X 
5, (£4, 42} а) = 8, (qy, a) \ 8, (q,, a) 
={q}U® 
={,) 
б„((4„,},5) = 8, (dy b) 6, (q,, b) 
= (a4) Y (4,4) 
= (0,4) 
Step 3: The final state Е, = ( {q,}, (4, 4,) } 


The equivalent DFA 
D = (Qy 2,8, qo Fy) 
Where 5 (4) 
Q, =a} (4.4, (2) 4 4) } i 
Salab) (4,9) 
в ={9,) *( 4,) (4,4) 


Е, ={{ Gh (4,4 {492} 


Construct a DFA equivalent to М = ((q, 9,9, 43} (0, 1), 5, qy (44) 
Where 5 is given by 


The equivalent DFA 
D = (Qy Z, 8, do Fy) 
x-(0,1) 
Step 1: q, = (4,) 
Step 2: 6, from { а, } onX 
5, (do 0) = б, (ay 0) 
={dy 4} 
5, Qo 1) = б, (q 1) 
={4} 
5, from { qy qj) оп 5 
8,0499) 0) = 5, (9, 0) Y ôy (а, 0) 
7(4,4) 7 (4) 
7(4,4,4;) 
5, (dy 4}, 1) = 8, Go 1) Y 6, (9,1) 
-(q)v(q) 
7(4,4,) 


Theory of Compute 


Step 3: 


5, from { qyq, q,) on X 
5, (099,9, 0) = 5, (ay 0) Y 5, (q, 0) UG, (а„ 0) 
7(4,4) 9 (4) (4) 


7(4,4,40,4,) 
5, (fap Ч» Ga} 1) = 8, (9, 1) 6, (q, DU 8, (9, 1) 
={4} 9 {4,} Y {4} 
= £99945} 
5, from {qy qy q,, q,) on Y 
5, 0499,9}, 0) = б, (q 0) Y 8, (q,, 0) чё, (Gy 0) о 8, (93, 0) 
7(4,4,)9 (4) (4) » 0 
= (49,99) 
5, Hay d, Ч» 43h 1) = 8, (y D Y ôy Ч, 1) Sy Gy NUS, Gy 1) 
={4} 9 {9,} 9 {4,} 9 {4,} 
= (49,99) 
6, from (q,4,q,) on 
5, Hao d, d3} 0) = б, (do 0) 8, (9,0) 6, (9,, 0) 
7(4,4)) {q} 0 
7(454,4,) 
5, (do q, I} 1) = 8, (9, 1) Y 6, (4,1) 6, (q,, 1) 
2(a)vtq)o(aq) 


7(4,4,4,) 
The final state Е, = ( {ao Vy Ч» 44, (4, 4,4) ) 
-. The equivalent DFA 
D = (Qy 3,6, ay Fy) 
Where 
Qo 7 (£4, (45 d, { Ч» Ч» 0, {ao Ч» Ч» 4, (49 45 4) ) 
X ={0,1} 
4, ={9} 
Fy = ((4 4, 4, 93}, (4, Ч» Ig }} 
8, 0 | 1 
— {4} {aoa} (a) 
{49} {9,99} {4 9,} 
{4,9,9,) (45,454, 9. } {ay 9,9. } 


* 099,99)  |(4545454,) |49999) 
* (454,4) (454,4, {ao dya} 


| 
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Prosiem 9 


Construct а DFA equivalent to N = ((P, Q, К, S}, (0, 1}, 5, Р, {0, SH 
Where 6 is given by 
0 1 
{05} {0} 
(R) (QR) 
{S} (P) 
"S| Ø {P} 


— SHEEP — — 


The transition diagram for the NFA, N is 


X88. Theory of Computation 


The equivalent DFA 
D = (Qy 2,8, du Fy) 
E ={0,1} 
Step 1: q,- (P) 
Step 2: 6, from (P) onX 
8, (P,0) = 8, (P,0) 
={ 9,5} 
5, (P, 1) = 6, (Р, 1) 
*(Q) 

ô, from { Q, S} on X 

5, ({Q, S), 0) = б, (0, 0) U 5, (5,0) 
={R}UO 
={R} 

8, ((0,5),1) =5, (0, 1) U 8, (5, 1) 
={QR}U{P} 
={P,QR} 

5, from {Q } on > 

5, (9,0) = 5, (Q, 0) 

={R} 
5, (0,1) =5, (0, 1) 
={ 9,8} 

5, from {R} on 

5, (R, 0) =, (R, 0) 

={5} 

8, (8,1) =5, (В, 1) ={Р} 

5, from ( P, Q, К } on £ 

8, (CP, Q, R}, 0 ) = б, (Р, 0) US, (Q, 0) US, (R, 0) 

-(QS)U(R)U(S) 

={0 8,5} 
8,(0Р,0,8}1)=6, (Р, 1) Y ô, (Q, 1) 58, (R, 1) 

={Q}U{QR}U{P} 

={P, QR} 


ô, from { Q, К} onX 

&((QR,0) =8, (0,0) 95, (R, 0) 
={R}U{S} 
={R,5} 

5, ({@R}1) = б, (0,1) 55, (R, 1) 

-(QR)U(P) 
={P,Q, R} 
ô, from (S) on £ 
8, ({5},0) = 8, (5,0) 
=ø 
6, ({5},1)=5, (5, 1) 
={P} 

6, from ( Q, R, S) onX 

5, ({@ R,5),0) =5, (Q, 0) Y 5, (А, 0) U8, (S, 0) 
={R}U{S}UO 
={R,S} 

5, ({0,8,5},1) =5, (0, 1) 8, (R, 1) v 6, (5, 1) 
={QR}U{P}U{P} 
={P,QR} 

6, from (R, S} on у, 

8, ({R,5}, 0) = б, (R, 0) б, (5,0) 

={5} 90 
={5} 

5, ({8,5},1)=5, (В, 1) Y ô, (5, 1) 

={P}U{P} 
={P} 
Step 3: Final state, Е, = ((0,5), {0}, (BG К), (QR, (5), COR SCR S)) 

2 The equivalent DFA 

D = (0, 2,8, q, Fp) 
Where Q, ={{Р}, {0,5}, {0}, {В}, CP.OG RS, {9,8}, (5), COR SCR S) 
E ={0,1} 
q, ={Р} 
Е, ={{ 0,5}, (0 (E.G RS (0,8), (5), (0,8,5), {RSH} 


5, | 0 1 
ms {9,5} {Q} 

* {9,5} {R} {P,Q,R} 
* (0) {R} (QR) 
{R} (5) {P} 

* {ров} | {QRS} {P,Q R} 
* {QR} (RS) {Р,0, К) 

* {5} 9 (P) 
* {QRS} (R5) {P,Q R} 
* {RS} (5) (P) 


РвовьЕм 10 


Convert the following NFA to DFA. 
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The given NFA 

N = (Qy E 5,4» Fy) 
Where Qu ={А,В,С} 

= ={0,1} 

Ч - (4) 

F, ={С} 


The equivalent DFA 
D = (Qy E, Sn dor Fy) 
E ={ 0,1} 
Step 1: q, ={А} 
Step 2: 8, from (A) onX 
5, (A, 0) = 6, (А, 0) 
={В} 
8, (А, 1) = 8, (A, 1) 
={А, С} 
6, from { В} onX 
5, (B, 0) = 5, (B, 0) 
={B} 
5, (B, 1) = 5, (B, 1) 
={А, С} 
8, from { А, С} on E 
8, (£4, C), 0) = 8, (А, 0) оё, (C, 0) 


={8}00 -(B) 
5, (4, C), 1) = 8, (А, 1) v, (C, 1) 
z(AC)uO 
={А,С} 
йер 3: Final state, Р, = ((A,C]) 
-. The equivalent DFA, 
D = (Qy 2,8, q, Р.) 5, 0 1 
Where Q, ={{A},{B}{4,C}} == (В) {АС} 
X ={0,1} 
amta ? {B} (8) {АС} 


Р, ={А,С} {АС} | {B} {АС} 
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Рковієм 11 


Construct a DFA equivalent to the following NFA 


The given NFA 6. 
N = (02,8, do Fy) 
Where Qy 7(q9,4,4;) 
E.-(ab) 
4 ={9} 
Е ={9,} 
The equivalent DFA 
D = (Q, Z, 6, q, Fp) 
E ={a,b} 
Step 1: = (4,3 
Step2: 5, тот { д, } onx 
б, (q, а) = б, (9, a) 
7(4,4,) 
5, (qy b) = 8, (9, b) 
={9,} 
6, from ( qy а) ond 
5, ( (qu q,), a) = 8, (9, а) Y 8, (4, a) 
= (49) Y (4) 
7(4,4, 


(4,4) (4) 
ta) (4) 
9 (4,4) 
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Step 3: 


5, ( {4 ч}, b) = 6, (9 b) Y б, (4, b) 
={49,} 9 {9,} 
-(4,4) 
8, from ( 9,} on £ 
5, (q,,a) = б, (q, а) 
=0 
8, (dz, b) = 5, (ay В) 
*(4,4,) 
5, from (q,, q;) on È 
5, ( (q,, а„}, а) = 8, Gy a) 8, Gy а) 
= {4,) 00 
={4,} 
8, (14) 42} b) = 8, (9, b) Y б, (9, b) 
= (9) 04,9) 
7(4,4,) 
Final state, F, = ( (q, } {4y 4) } 


* The equivalent DFA 
D = (Qy 2,8, I Fp) & -za b 
Where 
(9) |099) +} 
Qo = {doh { Ч» 9, }, 09,2, 60423) ( nn )( ) 
Z (ab) 9 d; 4, d; 4v d; 
nem * (4) 9 (454) 
F, ={ (9, }, (04,9 * {9,.4.}| {4%} {49} 
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If there exists NFA, N = (Qy, È, 5,, 9, Fy) which accepts the language L (N), there exists an 
equivalent DFA, D = (Q, 2, 5,, qy Fp) such that L (D) = L (№) 

OR 
Let L be a language accepted by a NFA, then there exists a DFA that accepts L. 


Proof: We have to prove that 5,* (q,, и) = 5,* (qy м) 


We know that if Q, represent states of NFA then power set of Q, which contains the set of 
subsets of Q, are the states of DFA denoted by Q,. The DFA interprets each set as a single 
state in DFA. 


Basis : Consider a string w = €, where | w | = 0 

8,* ({4)}, €) = {4}, by definition of extended transition function of DFA. 

5,* ((q,), €) = (q,), by definition of extended transition function of NFA. 

Hence 6,* (q,, W ) = 8,* (q,, w ) for some w where | w | = n. Now, itis required to prove that 
the statement. 5,* (q,, W) = &,* (q,, W) is true for some w where | w | = п + 1. 

Inductive Proof: Let w = x a, where a is the last symbol of w and x is the remaining string 
of w. 


So, |x| =nand 
|xa| =|w] 
=п+1 


By extended transition function definition of NFA, we know that 
5,* GoW) = 8y* (q xa) 
= б, ( б,* (dp. х,а) -@) 


Now, x is the string to be processed. After consuming the string x, let the states of the 
machine be {Р,Р,_____ P} 


Le, — By (qux) РВ P} 
Substituting this in eqn. (1) 
&y* (Ч, w) = 8, Р, Р, P, a) 
=, (P, a) U б, (P, a) U _--_ 6, (P, a) а 


By extended transition function definition of DFA we know that 
5,* (qu, W) = 8,* (а, x a) 
=5,* (8%, (qx), а) s) 
Now, x is the string to be processed and after consuming the string x, let the states of the 
machine be (P,P, Py 


ie, 8", (4х) = (РРР) 


Substituting this in equation (3) 
б" (9и) = 8, (P, P, р} а) 
= б, (P, a) US, (P, a) U____ 6, (P,a) EMO 
By comparing equation (2) and (4) 
&,* ( {9}, W) = 8,* ( {9}, W) 
so if 5,* ( (q,), w) is in Е, and 8,* ( {д}, W) is in Fy 
then both enters into final state accepting the same language. Thus L (N) - L (D). 


Hence, the proof 


In some situations, it would be useful to enhance NFAs by allowing transitions that are 
- not triggered by any input symbol; such transitions are called € - transitions. If there is a 

transition from one state to another state without any input (€). It is called € - transition. 
_ An NFA with zero or more € - transitions is called an € - NFA. 


Definition: € - NFA isa five tuple ( Q, £, 6, 4„ F ) 
Where Q is a non-empty finite set of states. 
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У is а non-empty finite set of input symbols. 

q, © 0, is the start state 

ЕС Q, is the set of accepting/final states 

5: QX (ХоЕ)- 2% is the transition function. 
Based on the current state there can be a transition to other states with or without 
any input symbols. 


E33 


2 


| E- МЕА, Е= (0,Х, 8,4, Е) 
| Where 0 = ( qy qy 4;) 
E={0,1,2} 
q,7(4,) 

F,7 (a) 
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€ - Closure (q) is the set of all states which are reachable from state q without processing 
any input symbol i.e., it is just the set of states that can be reached from д on € - transition 
only. 


Step 1: д is added to € - Closure (q) 


Step 2: If q, is in € - Closure (q) and there is an edge labelled € from д, to q, then q, is added 
to € - Closure (q), if q, is not already there. This is repeated until no more states can 
be added to € - Closure (4). 


Consider the following € - NFA. | 


€ - closure (q,) = (4, 9p 92} 
€ - closure (4,) = (4, 43} 
€ - closure (q,) = (q,) | 


Find the є - closure of all states for the given є - NFA. 


€ - closure (q,) = { qy qx 92} 
€ - closure (q,) = { 4,94, } 

€ - closure (q,) = {а,} 

€ - closure (q,) = { q, } 


—— ERE 1 


— чи 


Find the € - closure of all states for the given є - NFA. 


€ - closure (q,) = ( qy 4, 42} 
€ - closure (4,) = (4, q» 4,) 
= (4,4, 4;) 
€ - closure (4,) = (4, 4y 4) 
7(4,4,4;) 


| let E = (Q,, У, 6, qy Ё.) bean E - NFA. The equivalent DFA, D = (Qy У, 5, d, F,) can be 
constructed as follows. 
Step 1: Start state of DFA is € - closure (q,), where q, is the start state of € - NFA. 


| Step 2: Let the € - NFA transition be 8, ({q,, 9, - --- q а) = {P,, Py» ----- Р„} then 
transition of DFA, 5, ( { 4, 4, ---- 4% 9) = € - closure ({P,,P,,----P,,}) 
Step 3: If (q, qp ---- 4, } is a state in DFA and if this set contains at least one final state of 
Е- МЕА, then { 4,4, ----% ) is a final state of DFA. 


— — — arm 


Convert the following c - NFA to its equivalent DFA. 


Dp-—-o — j 
| а b ) "i 


The given € - NFA 
Е = (Qy >, 6, q, Fe) 


Where 
Qe 7 (4, 4, I} 
X -(abc) 
q, =49,) 


Е; (4) 


os ООО 


The equivalent DFA, 
D = (Qy Z 8y Gow Fo) 
У ={a,b,c} 


Step 1: Start state of DFA 
Mp = € - closure (4,)= (4, 4, 4;) 
Step 2: Transitions of DFA 
6, from {qy qy q,) on E 
8, (044,9), а) = € - closure (8, Hay Ч» 42} 9) 
= € - closure (8, (qy a) Y 8, (9, a) V5, (q,, a)) 
=€- closure (9,0000) 
- € - closure (q,) 
= (4,4, 42} 
5, (fq, 4, Q} b) = € - closure (5, (4,9,9), B) 
= € - closure (5, (qy b) U8, (qy b) У ё, (а„ b)) 
= є - сіоѕше (079,00) 
= € - closure (q,) 
= {qp a} 
5, (dy 4, Gh © = Є - closure (б, (4, dy 4), ©) 
= € - closure ((8, (qy c) Y 8, (q, c) Y 8, Gy c) 
= €-closure (ØU 9 0 q,) 
= € - closure (q,) 
={9,} 
8, from { 9,,9,} on У 
8, (qx 4,}, а) =Е- closure (5, (14,4), а)) 
= € - closure 6, (q, a) U5, (9,, а))) 
-€-closure(0 590) 
- € - closure ( 0 ) 
=@ 
8, ((q, q2} b) = € - closure (8, ((q,, 42} DD) 
= € - closure (5, (q, b) 6, (а, b)) 
= € - closure (9,00) 
= € - closure ( q, ) 
= {qy I} 
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5, ((q,q4,, c) =E- closure (б, (49,9), 9) 
= € - closure (8, (q, c) Y 8, (4„ D) 
=€- closure (Ø Uq, ) 
=€- closure (4, ) 
={9,} 

5, from { а,} on X 

5, ({а,}, a) =Е- closure (5, { q,), a) 
= Є - closure (Ø ) 
=0 

5, (4..0 =E- closure (6, ((4,), b)) 
=€- closure (Ø) 


5, ({9,}, 0 = € - closure (6, ((q,), c)) 
= € - closure ( q, ) 
={9,} 


Step 3: Since q, is the final state of € - NFA, all the sets having д, as a member will be the 
final state of DFA, F, { { qy 4, 4, (4, 4; (4,3) 


: The equivalent DFA D = (Qy У, 8,, Ч.» Fo) 
Where Q, = { {4y 4,4), (454,5, (4,3) 
L={a,b,c} 
4,57 (45 Iv I} 
Е, = ((45 45 4, (4,4, 09,1) 


5, а b € 
Edy Wy 42} | (8,454) (4,4) (4) 
*(4,4,) 9 (4,4) (4) 


*{9,} 9 ® (4) 
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PRosLEM 4 


Convert the following c - NFA to its equivalent DFA. 


The given € - NFA E = (Q, È, б, qy Ё.) 8. 
Where 


a b € 


9 | 0 {a} (q) 


Qe ={4,9,9,) 

Z ={ab} а, |(q) 9 {9} 
ф =й, *4, |49} {aq} 9 
Е, ={9,} 


The equivalent DFA. D = (Qy E, y 4oy Fp) £ = (a,b) 
Step 1: Start state of DFA 
don = E - closure (9,)= ( q q, 42} 
Step 2: Transitions of DFA 
5, from (q, q, 4, } оп у, 
5,019,492, а) = Є - closure (5, ay 4 44}, а) 
= € - closure (6, (qy a) U 6, (q,, a) U 6, (9, a)) 
7€-closure (0 Uq,U q,) 
= Є - closure (q,) 
= {4%} 
604,9,,9,), b) = € - closure (8, Kay 4, 9,}, 0)) 
= € - closure (5, (qy b) U 6, (4, b) U 6, (q,, b)) 
-€-clsure(q, UQU q,) 
= € - closure (q,) 


7(4,4,4,) 
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5, from (q,, q;) on A 
5, dy aba =E- closure (8, {4,„ 42} a) 
= € - closure (6, (q, а) U5, (4„ a)) 
= € - closure ( q, 4, ) 
= € - closure (q,) 
= {442} 
5, (Cq, 4}, b) = € - closure (8, (£ q, 42} В)) 
= € - closure(8, (q, b) ^ б, (q,, 5) 
= €-closure( 9 »q,) 
= € - closure (q,) 
7(4,4,4,) 
Step 3: Final state of DFA Е, = { { qy 4, q} (4 9,}} 
s The equivalent DFA D = (Qy X, 8w Gow Fo) 
Q, = {199 4 4), 4, DI} 
L={ab} 
Gon = (4o d, 9} 
Е,= (£a, 4, ab C4 23) 


5, {^+ b 
{dor I I) |04,9.) 499,9) 
{dy} (4,4,) (40 Iv Ge} 


Prostem 5 


Convert the following е - NFA to its equivalent DFA. 


The given € - NFA, б, а b € 
E = (Qo Y, 8, q, Fe) 4| (4) 9 0 
Where 9, 9 (4,) 9 
Q,7 (q, d, d» Ч» Gy d, Vor 5 d, Gob «o? 0 (44) 
У = {а,Ь}, «4| 9 9 (9,9, 
Е q, (4) 0 0 
4,7 d, | Ø 0 (a) 
Е. ={9,} q«| 9 (4,) @ 
| 0 9 (4,3 
%| © 9 {9,4} 
"Gs д 0 @ 


Step 1: Start state of DFA, 5,, = € - closure (q,) = (q,) 
Step 2: Transitions of DFA 
5, from {q,} on У, 
5, (qy a) = € - closure (8, ({q,}, а)) = € - closure (q,) = { q,} 
5, (9, b) = € - closure (6, ({q,}, b)) = € - closure (Ø) = Ø 
6, from (q,) on X 
5, ({ ч, }, a) = € - closure (6, ({q,}, a)) = € - closure (Ø) = Ø 
5, ({ 4,}, b) = € - closure (8, ((q,), b)) = Є - closure (4,) = (45 4, Ч» Ger Io} 
6, from (q, qy q, q, Io} on У, 
50999,99}, а) 
= Е - closure ( 8, (dy 934,99), а)) 
= € - closure ( 5, (q, а) U6, (9, a) 5, (9, а) U5, (9, a) Y 6, (q,, a)) 
-€-closure(0 00 0(q,))u 9070) 
=€- closure (q, ) 
= (45 Ч» d, Iy Ч» 44) 
= {99,9599 9} 
50999,99}, b) 
= € - closure ( 8, ((q,, Qy Ч» Ч„ 9}, b) 
= € - closure ( 6, (q, b) U5, (qy b) Y 6, (q,, b) 6, (qu b) UV 5, (Gy b)) 
= Є - сЇоѕиге (007000 0{9,} 00) 
= € - closure ( q, ) 
= (45 Ч» 4, d, d, Io} 
= (454,45 Ч» Ч» 9) 
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5, from {qy qy Is» q, Ч» Ч} on у, 
5, (ay q, d, Go d 4} а) 
= € - closure (5, ((q,, qy 45 94 9} a)) 
= € - closure ( 8, (q, a) Y б, (4, a) \ 8, (q., a) \ 6, (q,, a) UV 6, (qa a) V6, (а a) 
=€-closure(@U{q,}UBUBUBUBLUD) 
= € - closure (q,) 
= (45 dy 1y Iy d, Toh 
= (454, 45 4, Ч» Go} 
5, ({ 4, q, d 99%} В) 
= € - closure ( 6, ((a, Vy 45 Ie Ч» Go} В) 
= € - closure ( 5, (q, b) U5, (qy b) U 8, (q., b) U 6, (ay b) U 6, (aa b) U 6, (Qy b) ) 
-€-cosure(ÓUO2UO9U(q;,)U9U0) 
=€- closure ( q;) 
= (45 45 05 4, d, Io) 
= (4, 4, 45 Ч» d, To} 
6, from (q, qy qo Ч» q, q,) on У, 
5, ({ ay Ч» qo Ч» Ч» To} а) 
= € - closure ( 8, (q, a) U 8, (q, a) U 8, (q,, a) U 6, (а, a) U 6, (q,, a) U 5, (а, a) 
-€-cosure(0U(q,.)j 90060600) 
= Є - closure (4,) 
= (45 Ч» d, Ч» d, Go} 
= {qy Ч» Ч», 45 Ч» To} 
5, ({ 4» 4, Vor Ч» 99}, b) 
= € - closure ( 6, (q, b) U ё, (q, b) U 6, (q,, b) U 6, (q, b) U 8, Gy, b) U 8, (qy b) 
-€-clsure(OUOU(q;,)UOUOUO9) 
= Є - closure (q,) 
= (4,993,999) 
= {qy 9969» 9 9) 
Step 3: The final state Е, = { { qy qy Ч» d, Gob (d d, ds d Ч» 4%}, (99,99,99) ) 
+ the equivalent DFA D = (Qy Y, 8y dy Fp) 
Where Q, = { {4} {9,5 (45 4 4, ao 93}, {99,999 9} (45 Qy Qo Ч» d 43} } 
X-(ab) 
Gon = (4) 
Е, = (04,9999), (99,9599 9}, (99,99 9 93} ) 


ô a b 


» 
(a (a1 6 
(4,3 9 { 4» Ч» Ч» do Io } 
*{4» dy Ч» IIo} | {99,9999} (450545 9» Ч» d,) | 
* {ay ly d, do dp Go} | {99,99,99} 19599999} 
"(0545 d, Ч» Ч» Go} | {Ч Ч» Ч» Ч» ddo} (454, 05 Ч» ds d.) 


{ay Ч» d» do d, Goh 


(d, 4, do Ч» ds, Toh 


AUDIRE 


A language L is accepted by DFA, D, ifand a if L is accepted by an € - NFA, E. 

Proof: Let E = (Q, Y, 6, qy F,) be an € - NFA and let the DFA obtained from it bi 
D = (Qy Y, by qu Fp). 

Since all the transition of DFA are obtained from the transitions of € - NFA, the language 
accepted by € - NFA is also accepted by DFA. This can be proved using mathematicd 
induction as shown below: 


dies ub 


Basis : If w = €, we know that 6,* (q Є) = € - closure (q,) - - - - - (1) 
We also know that q,, = € - closure (q,) is correct since that is how the start state of DFA i 
obtained so, if w = Е, then 6,* (q,,, €) = € - closure (d**--- (2) 


From eqn. (1) and (2) 

&," Gow €) = &,* om €) 

Thus, we have proved that language accepted by € - NFA is same as language accepted by 
DFA when и = €. 


Introduction Hypothesis: Let w = x and assume that the result is true for the string x 
ie,&, (4х) | 75, (9х) = (4,4 ----- 4,) 

istrue for the string x. 

Now we have to prove that the result is true for w = x a. By definition of 8* for € - NFA, we 

compute 6,* (q,, w) as shown below: 


Let 8, ((, d, 4b a) = {Py Py----P,}----- (3) 
then 6,* (9, м) = € - closure ({P,, P... Passo (4) 
Thus, 8,* ( q,, W) = € - closure ({P,, P,,____- Р})----- (5) 


Equation (3) and (4) are used in the construction of DFA from € - NFA. 
Thus, 6,* (9, W) = 6,* (9, w) 


Difference between DFA, NFA and € - NFA 


ТЕА isa 5 - tuple NFA is a 5 - tuple | €-NFA isa 5 - tuple 


|0=(0, 7,6,4 F) [N= (@ E 5a, F) [E= (@ £5, av F) | 

lioxXyn20 8: QK E20 || [8:QX(ZU92 2 il 

‘DFA can have only опе | NFAcan have zero, one or more | € - NFA 15 а NFA with zero or | 

‘transition from a state on an | transitions from a state on an | more Е - transitions | 
__|inputsymbol — — |" 


‘Less powerful since at апу | More powerful than DFA since | More powerful than NFA since 
‘point of time it will be in only | at any point of time it will be in | at any point of time it will be | 
Jone state more than one state in more than one state with or | 

__| without giving any input_| 


1. Define Symbol, with an example. 
2. Define Alphabet with an example. 

3. Explain string, length of a string and empty string. 
4. Define Language with an example. 

5. Define DFA. 

6. Define NFA. 

7. List out the different types of finite automa. 

8. Explain Language acceptance of a DFA. 

9. Explain € - closure (q) 


. Explain Finite automata in detain with an example. 


- Write short notes an Applications of finite automa. 

. Define Language and operations performed on the language. 

‚ Define extended transition function of DFA. 

. Differentiate between DFA, NFA and Е - NFA. 

. Define a DFA such that L(E) = L(D) 

- Construct а DFA to accept all strings on { a, b ) having the prefix 'baa'. Simulate the behavia 


of DFA on baabab, abaab. 


KEKE 


REGULAR EXPRESSION 


In this chapter, we define regular expressions as a means of representing certain subsé 
of strings over X and will prove that regular sets are precisely those accepted by fini 
automata. We use pumping lemma for regular sets to prove that certain sets are not regul 
Then we discuss about the properties of regular expressions. 


EM 


A regular expression is recursively defined as follows. 
* '0' is а regular expression denoting an empty language. 
* '€'isa regular expression denoting the language containing an empty string. 
* 'a'isaregular expression denoting the language containing only (a) 


* If R is a regular expression denoting the language L and $ is a regular expressio: 
denoting the language Ly then 


* К+5 15 агевшаг expression corresponding to the language L, U Ly 
* R-Sis a regular expression corresponding to the language Lg’ Ly 
+ К" is a regular expression corresponding to the language L,. 
* The expressions obtained by applying any of these rules are regular expressions. | 


Let а } and regular expression, К = a* then Ris а set denoted by 


L = {Е, а, аа, ааа, аааа,____ ] } 


The basic operations of regular expressions are concatenation, Union and Kleen closure. 
Let К and S be any two regular expressions. 
Concatenation: Concatenation of regular expression В and S is RS = (xy|x € Rand y € А) 


If = (ab, c) and S = (d, ef} then RS = ( abd, cd, abef, cef) 


Union: Union of regular expressions R and Sis R +5 = (x| xe Rorxe $} 


| Example : 

IfR= (ab, с} and $ = (d, ef} then R + 5 = (ab, c, d, ef} 
‘ene Closure: Kleen closure is the set of all strings, that can be made by concatenating 
‘zero or more strings іп В. 


| Example 
IR = (ab, с} then R* = (€, ab, c, abab, сс, abc, cab, _____ H 


let P,Q, and В be any arbitrary regular expression. Then, the following properties are true. 
1 €R=RE=R 10. (Р+0) R- PR * QR 


2.€*-e€ 11. (P+ Q)* = (P* Q*)* = (P* + Q*)* 
3. (0)- € 12. R* (R*+ В) = (R* + К) R* = R* 

4 OR=RO=0 13. (В+ R)* = R* 

5. 0+R=R 14. € « R* = R* 

6. R+R=R 15. (PQ)* P = P (QP)* 

7. RR*=R*R=R* 16. R*R+R=R*R 

8. (R*)* = R* 17. (PQ)* = (P* Q*)* = (P* + Q*)* 

9. €+RR*=R* ‚ R* R* = (R*)* = R* 


Set of strings of zeros of any length including € 


Set of strings of zeros of any length excluding e (atleast one 0) 


0+1 Set of strings consisting of either one 0 or one 1. 
(0+1)* Set of strings of 0's and 15 of any length including € 
(0+ 1)* Set of strings of 0's and 1's of any length excluding є 
(0+1)* 011 Set of strings of 0's and 1's ending with 011. 
01 (0 + 1)* Set of strings of 0's and 1's starting with 01 
0*1*2* Set of strings of zero or more 0's followed by zero or more 1's followed by 


zero or more 2's including є 


Set of strings of any number of 0's followed by any number of 1's followed 
by any number of 2's excluding є 
_| 


Set of strings of 0’s, 1's and 2's with atleast one zero, followed by atleast 
one 1, followed by atleast one 2 


(0 + 1)* (0+ 11) Set of strings of 0's and 1's ending with either 0 or 11. 


orz 


00* 11* 22* 


(00)* (1*1 Set of strings consisting of even number of 0's followed by odd numb: 


of 1% 
(0+1)* 000 Set of strings of 0's and 1's ending with three consecutive 0'5 
(11)* Set of strings consisting of even number of 1's | 
1+ (01)* The language consists of a string 1 or strings of (01)'s that repeats zeri 
or more times 
0 (1* + 1) Set of strings of 0 followed by any number of 1's 
(1+ €) (00* 1)*0* | Strings of 0’s and 1's without any consecutive 1's 
(0 + 10)* 1* Strings of 0's and 1's ending with any number of 1's 
(0+ 1) (0+1) Strings of 0's and 1's whose length is 2 


(0 + 1)* 00 (0+1)* |Setofstrings of 0’s and 1’s of any length having a substring 00. 


Set of strings starts with 0 or 1 and has atleast one 1, after the first 1; 
0*1 (0* 10* 1)*0* | all 1's appear in pairs. Any number of 0's can appear in any place in the 
string. The string contains an odd number of 1's. 


Write the RE for the language accepting all combination of a's over the set, £ = (a) 


— — €D 


L= {Е, а, аа, ааа,____} -Rza* 


— arm 


Design the RE for the language accepting all combinations of a's except the null string 


over E = {а} 


1 = {а, аа, ааа, аааа, ____} 5 В=а 


Design а RE for the language containing any number of a's and 65. 
E-(ab) 


L = (€, a, b, ab, ba, aa, bb, abab, bab,____} 
* Rz (a + b)* 


Construct the RE for the language containing all the strings which ends with 00 over 


thesetZ = (0,1) 
L = { 00, 000, 100, 0100, 1000, 
2 Rz (0 + 1)* 00 


о а о 


Construct the RE for the language consisting of the set of all strings of 0's and 1's 
beginning with 0 and ending with 1. 


r={0,1} 


L={01, 001, 011, 0011, 0101, 001011,_____ } 
^ В=0(0+1)*1 


Construct a RE for the following language. 
[ = (e, 11, 1111, 111111, ____} 


z-(1) 


Any element of L is either € or a string of even number of 1's. 
2 В= (11)* 


С — n —— 


Construct a RE for the language consisting of all strings of a's and b's beginning with 
aand ending with ab. 


X-(ab) 


L = (aab, aaab, abab, aabab, aaaab, abbab, _____ } 
^ R=a(a+b)* ab 


— — — arm 


Construct a RE for the set of strings of 0's and 1’s that should contain the substring 


000. 
r={0,1} 


L = { 000, 0000, 1000, 00001, 10000, 1100000, 01000,,_____ } | 
д R= (0 + 1)* 000 (0 + 1)* | 


Give a RE for representing the set L of strings in which every 0 is immediately 
followed by atleast two 1's. 


— чаю ——— 


5={0,1} 
The elements of L is zero ог more occurrences of 1 or 0 followed by 11. 
ie, L= {1, 11, 011, 1011,____} 
« В=(1+011)* 


Construct a RE for the set of strings of a's and b's, ending with either a or bb. 


— _ чаю» ——— 


E-(0,1), L= (a, bb, aa, abb, baa ____} 
^ R= (a + D)* (a + bb) 


Construct a RE for the language, 0 followed by zero or 1's or 1 followed by zero or 


more Q's. 
= ={0,1} 


L = {0, 1, 01, 10,011, 100,____} 
2 В=01*+ 10* 


[тых ШЕ 
— ear ЕЕЕ 


Write RE for the following language, 1 followed by zero or more 0's and ending with 1. 
={0,1} 


L ={11, 101, 10001, ____} ^ Е =10*1 


Write RE for the set of strings over alphabet (a, b, c) containing at least one a and one 


b. 
X-(a,b,c), L= (ab, aab, aabb, abbbc, ____} 
^ R=(a+b+c)*ab(a+b+c)* 


о т о 


Draw the DFA for all strings that have atleast one 0 over the alphabet (0, 1) and write 


the RE. 


X-(0,1) 
DFA 


7 R=1*0(0+1)* 
Draw the DFA for the set of all strings which starts from 10 and ends with any number 


of 1's. 


Z-(01) 
DFA 


| Qi j 
Eo :.o — j 


. В = 101* 


Obtain a RE representing strings of a's and b's having even length. 


X-(ab) 


L = (aa, ab, ba, bb, aabb, abab, _ E 
* R= ((а + b) (a + b))* 


Write a RE representing strings of 0's and 1's having odd length. 


2={0,1} 


1={0,1, 001, 10101, ___} 
> В=(0+1 ((0 +1) (0+1))* 


Obtain a RE for the set of strings containing exactly one a over E = {a,b,c} 


L= {a, ba, cab, bcabc,____} 


* R=(b+c)*a(b+c)* 


Write a RE for the set of all strings with no two consecutive a's, where È = (a, b). 


L= { а, aba, bab, bababa, ____ 


} 
> Rz(b*ab)*(a«€) 


Obtain a RE for the set of all strings with exactly two b's over E = {a,b} 


———euump — 


L = ( bb, abba, ababa, Edom 
^ R=a* ba* ba* 


— — — — erm — — —— 


Obtain a RE for the set of all strings with atleast two b's over = (a, b } 


— «umm» — — 


L-(bb,abab,bbbb, ____} 
« R= (a + b)* b (a + b)* b (a + b)* 


Construct a RE defining the language consisting of all words that contain exactly 3 b's 
in total. Where У = {a,b} 


— — qD 


L = (bbb, abbb, bbba, babb, bbab, bababaa, ... ay 
2 R=a* ba* ba* ba* 


Obtain a RE for the set of all strings that do not end with 01, over {0,1} 


— — q 


Itis given that the string should not end with 01. So other strings whose length is 2 and that 
do not end with 01 are 00, 10 and 11, 000, 010 etc., These strings can be preceded by any 
combinatioris of 0's and 1's denoted by (0+1)*. These strings can end with 00 or 10 or 11. 


^o RE,R= (0 + 1)* (00+10+11) 
This procedure can be explained easily with an example. 


— — — arm 


Construct DFA for the regular expression (а | b)* a b b 


— — шшш» ——— 


Step 1: Augment the given regular expression with the symbol #. 
(a|b)*abbit 

Step 2: Give position to each symbol in the regular expression including # symbol. 
(a|b)* a b b # 
i2 34 56 


Step 3: 


Step 4: 


Step 5: 


Find Firstpos of the given regular expression. Firstpos is a set that contains t 

positions of all the symbols which can be at the beginning of a valid word of t 

regular expression. 

Firstpos becomes the start state of DFA. 

Firstpos ( (a | b)* abb # ) is { 1, 2,3} | 

‘T'is included in the Firstpos because of word | 
a b a b b # (o) a a a b b # etc... | 
123456 113456 | 

'2' is included in the Firstpos because of the word 


bab b # (oR bog Bb (ob aa bbs | 
23456 2234056 213456 | 
‘3’ is included in First pos because of the word 
a b b & 
34 56 
Start state of DFAq, = { 1,2,3 } 
aba 


Find followpos of each symbol. Followpos of a symbol is a set which contains the 
positions of all the symbols which can follow the current symbol. 
In the regular expression 

(a|b)*a a b # 

123456 

Followpos (1) = (1,2,3) 
Followpos (2) = { 1, 2,3} 
Followpos (3) = { 4} 
Followpos (4) = (5) 
Followpos (5) = (6) 
Followpos (6) = @ 
Find set of states of DFA and transitions. 
For the start state qy Find transition for > = (a, b) 
Since a occurs in first and third position in 4 

ô (q, а) = Followpos (1) U Followpos (3) 

={1,2,3}U{4} 
7(12,3,4) (9) 
{a,b,a,b} 

Since b occurs in second position in dy 

ô (q, b) = Followpos (2) 


={1,2,3} > (@) 


For the new state q, find the transition for = { a, b) 

6 (q, a) = Followpos (1) Y Followpos (3) 
={1,2,3} {4} 
={1,2,3,4} (2) 

б (q, b) = Followpos (2) Y Followpos (4) 
={1,2,3}U{5} 
={1,2,3,5}э (4) 

abab 
For the state q, find the transitions. 


ô (q, a) = Followpos (1) U Followpos (3) 
={1,2,3}U{4} 
={1,2,3,4} ә (4) 

5 (q, b) = Followpos (2) Y Followpos (5) 
={1,2,3}U{6} 
={1,2,3,6}>@) 

aba# 

for the state q, find the transitions. 

ô (q, a) = Followpos (1) U Followpos (3) 
={1,2,3} {4} 
={1,2,3,4} (а) 

6 (q, b) = Followpos (2) 
={1,2,3} > 

Since there is no. new state, stop the iteration. 

Step 6: The DFA M is defined as 

М = (0,5, 5,q, F) 

Where Q -(9,4,4,4,) 

У ={a,b} 

4, = (4) 

Е = (q,) since # occurs in q, 


Construct DFA for the regular expression a b* + b 


Step 1: 


Step 2: 


Step 3: 


Step 4: 


Step 5: 


— a 


Argument the regular expression with the symbol # 
(a b* + b) # 
Give position to each symbol including # symbol 
(a b* + b) # 
1 2 34 
Find firstpos of the given regular expression. 
Firstpos becomes the start state of DFA. 
Firstpos ( (a b* + b) #) is {1,3} 
Start state of DFA q, = { 1,3, } 


ab 
Find followpos of each symbol. In the regular expression 
(a b*+ b)# 
1 2 34 
Followpos (1) = (2,4) Followpos (2) = (2,4) 
Followpos (3) = (4) Followpos (4) = 9 


Find set of states of DFA and transitions 
For Start state q, find the transitions 
Since a occurs at first position in ГА 
б (qy а) = Followpos (1) 
={2,4}> 
bi 
б (9, b) = Followpos (3) 
={4}ә4, 
For the state q, find the transion 
$(q,a) =Ø 


5 (q, Б) = Followpos (2) Y Followpos (4) = (2, 4) vf 6}={2,4}>а, 
For the state q, Find the transition 
ô (q,a) =0 
54,5) =0 
Step 6: The DFA M is defined as 
М = (QE, 8, qy F) 


Where 
Q = (4, 4, 42} 
X = {a,b} 
4, = {I} 
Е = {4,,9,) as # occurs in both q, and q,. 


Pier СУ: 


let'r' be a regular expression. Then there exists an Є - NFA that accepts L (r). 
(or) 
Prove that there exists a finite automation M = ( Q, E, $, 9, F ) to accept the language L (r) 
corresponding to the regular expression r. 

Proof: We show by induction on the number of operators in the regular expression ‘r’ that 
there is an NFA, M with € - transitions, having one final state and no transitions out of this 
final state, such that L (M) = L (r). 
Basis of Induction (zero operators) 

Consider the case where ‘r’ has zero operators. Then ‘r’ must be either Є, Ø, or a (for some a 
in E). For each of these 3 cases, the corresponding NFA's are given as follows. 


If r- €, then 
f "i j 
—>@) |=“ 07 @| 
Ifr=@, then If r =a, then 


Eo g 


Now, we have to prove that if the RE contains i operators also, we can construct i 
equivalent NFA with € - moves. 
Suppose r has i operators, the following 3 cases occur 


Case 1: 
Case 2: 
Case 3: 


Case 1: 


r-r,*r, (union) 
r-r,:r,(concatenation) 
r=r,* (closure) 
Where r, and r, have less than i operators and r has i operators. 
Ph +, | 
By induction hypothesis there exists an NFA with € - moves corresponding (ой 
andr,. | 
Consider the NFA corresponding to г, аз M, = (qp X, б, q, f, ) and corresponding 
tor, as М, = (Q, E, 6, 4, f, ) such that L (М,) = L (r,) and L (M) = L (r,) 
Now let us construct an МЕА M corresponding to r as follows. 
Let q, bea new initial state and f, be a new final state construct 
М =(QUQU (5f EOE 5,4,7) 
Where 6 is defined as follows. 


1. 8 €) -(4,,4)) 
2. 5 (q, a) = à, (q, а) for qin Q, - (f) and a in £ U (e) 
3. 6 (q, a) = 5, (4, a) for q in Q,- (f) andain х,о (c) 
4. 5(f, €) =f, 

5. 6(f, €) =f, 


The equivalent transition diagram is as follows. 


г, 15 accepted by M through the path 4,0, ff, and r, is accepted by M through 
the path q, q, p. 

Thus M accepts r, +г, 

M accepts r. 


(ase 3: 


rrr 
inte 
Let M, and M, be аз in case 1. Now, we will construct the € - NFA, M corresponding 
to газ follows. 


M =(0,00,, £, U 2y 8, qy f) 
where q, is the initial state and f, is the final state. 6 is defined as follows. 
$(f,€ =ч, 
5 (q, а) = б, (q, a) for q in 0, - (fj) andainZ,u (e) 
ô (q,a) = 6, (q, a) for q in Q, and a in Z, {E } 
The equivalent transition diagram is as follows. 


M accepts r, from q, to f, and then using € - transition itgoesto 4, 
r, is accepted from q, to f,. 
M accepts г, * г, 
r=r* 
By inductive hypothesis there is an NFA with € - moves corresponding to r, as 
M, = (Q, X, 6, q, f) such that L (Mj) = L (r,) 
Now, we construct an NFA, M corresponding to r as follows. 
M = (Q,U {ayfa} 2,9 doh) 
Where д, is the new initial state and f, is the new final state. 6 is defined as follows. 
54, © - (4) 
5(f,€ =a f) 
ô (Ч, a) =5, (q, а) for q in Q, - (f) and a in X,U (e) 
The equivalent transition diagram is as follows. 


M accepts r,* and hence we have constructed € - NFA for r which has i operators. 


Hence the proof by induction. 


ES 
o — r — —— 


Construct an NFA with c - moves for 01. 


To accept 0 To accept 1 To accept 01 


© BOO 


Construct on NFA with е - moves for 0 + 1. 


To accept 0 To accept 1 


(A) O O0) 


To accept 0 + 1 


Construct on € - NFA for 0* 


— q ——— — 


To accept 0 To accept 0* 


50-9] 


C ELE 


PnosLEM 4 


Construct on € - NFA for the regular expression 00* + 1. 


To accept 0 To accept 0 


29-8] 26-8) 


To accept 0* 


To accept 00* To accept 1 


Theory of Computation 


РвовьЕМ 5 


Construct a є - NFA for (0* 0) + (1* 0) 


— — q — —— 


To accept 0 To accept 0* 


ДО 


To accept 0 


To accept 1 To accept 1* 


mma | y o" 


<+@)° +@) 


To accept 0 To accept 1*0 


€ 


: 


To accept (0*0) + (1*0) 


PRoBLEM 6 


For the regular expression (0 + 1)* 1 (0 + 1) construct an є - NFA. 


To accept (0 + 1)* 


в 


E- 


T LCS. 
ES =» E 


To accept (0 + 1)* 1 


To accept (0 + 1) 


Construct on NFA with c - 


moves for the regular expression (0* + 1*)* 2* 3* 


- a 


То ассерї 0* 


То ассерї 1* 


С 
є (E) 1 +@) € 


а= 
O> 


To accept (0* + 1*)* 


КИ 


To accept 2* 


Theory of C omputation 


To accept 3* 


To accept (0* + 1*).2*.3* 


+O OOOO Oa 


Prosiem 8 


Construct an NFA with -moves for the RE (a+b)* cd 


— — q 


To accept a To accept b 


To accept a +b 


To accept (а + b)* 


To accept c 


Arden's Theorem: Let P and Q be two regular expressions over X. If P does not contain €, 
then the equation 


К = 0 + RPhasa unique solution. К = QP* 
Arden's theorem is used to find the regular expression from Finite Automata. 
Algorithm to find regular expression from FA. 
(i) Let q,, be the initial state. 
(ii) q, q, 9, be the number of states. 


(iii) q is the final state where j < n 


(iv) Let а, represents transitions from q,to q, 
(v) Calculate q, such that q, - 91:9 
(vi) For the start state q,, 479,q,*€ 


(vii) Compute final state which ultimately gives the regular expression. 


Construct Regular Expression from the given DFA 


Step 1: q, isthe start state. 


Step 2: Calculate q, such that 4, = €, 9, + Z where a, is the transition from q,to q, 


4, =9. а+е 
q, Saye 

q, =Е.а* [> Arden Thm R = 0 + RP then R = QP*] 

q, =а* [г e a* s a*] | 


Step 3: Calculate q, such that q, = 99 


4, =9, 6+4, | 
q, -a*b*q,b 

q, = (а* b) b* [- R =Q + RP then К = QP*] 

q, =а* bb* 

q, =a* b [b+ b*=b'] 


We don't want to find out q, equation because q, is the final state. 


The regular expression is given by a* b* 


— arm — — — 


Construct a regular expression from the given DFA 


Step 1: q, is the start state 
Step 2: Calculate q, 
q, *4,0*q,0*€ 
Step 3: Calculate q,, q, 
4, *q/1*4,1*q,1 
4, 74,0 
Substitute д, in q, 
9, =9;1+9/10+4/1 
9, =9,(1+01) +41 
4, 7*4, 1,4, (1 + 01) 
q, =9,1(1+01)* [+ If R= 0 + RP then К = QP*] 
Substitute in q, 
9, =9,`0+9,`0+є 
9, 74,0*4,:00* € 
q, =9,'0 *[q,: 1(1*01)*]00 + є 
q, =q, [0 + 1 (1 + 01)* 00] + € 
q, =€ * q,[0 * 1 (1 + 01)* 00] 
q, = є [0 + 1 (1 + 01)* 00]* [By Arden's Theorem] 
q, = [0 * 1 (1 + 01)* 00]* [: € -R- В] 
Since 4, is the final state the required regular expression is [0 + 1 (1+ 01)* 00]* 
9, =9,0+9,1+9,0+9,1 


=є:0+є:1+0,(0+ 1) [4,27€] 
=0+1+49, (0+1) Е :В=К] 
9, =9,0+4,1 


а, =ч, (0*1) 


=[0+1+4, (0 + 1)] (0+1) 
q, = [(0 + D] (0 + D] + q, [0+ 1] (0 +1] 
9, = (0+ 1) (0+1) [(0 + 1) (0 + Dy [- IFR =Q + RP then R= QP*] 
Since q, is the final state, the required regular expression is 
(0+1) (0+ 1) [ (0+ 1) (0 + 1)]* 


Construct regular expression from the given DFA. 


Step 1: q, isthe start state 
Step 2: Calculate [A 
4, 7 €. Because q, does not get any insert. 
Step 3: Calculate q, and 4, 
4, =%0+4,1+4, 0+4, 1 
4, =9, 0+4,1 
Since q, is the final state the required regular expression is 9,-0+q,.1 


PRosLEM 4 


Construct regular expression for the given DFA. 


Step 1: q, is the start state 
Step 2: Calculate q, 
4, 74,0*4,0*q,0*q,* € 
Step 3: Calculate q,, q; 4, 
4,74,1*4,1*4,1 
4, 74,0 
4, 74,1 
substitute q, in q, 
q, 74,01 
4, 74,1*4,1*4,1 
substitute q, in q, 
q, 74,1*4,1*4q,011 
4, =9%1+4, (1 + 011) 


а, =q, 1 (1 + 011)* ГЕК =Q + RP then R = QP*] 
4, =9,0+9,0+1,0+є 
= qa 0 + (q, 0) 0+ (q, 01) О+е [:4,=4,01] [9,=4, 0] 


=q, 0+4, [00+ (01) 0] + € 
substitute q, in the equation of q, 
q, = 4,0 + [q,1 (1 + 011)* (00 + 010)] + € 
do 74,0 +9, [1 (1 + 011)* (00 + 010)] + € 
q, 74,0 [0 + [1 (1 + 011)* (00 + 010)] + € 
q,7e*q,[0*[1(1*011)*(00«010] [+ IFR =Q +R P then R= QP*] 
4, = € [0 + [1 (1 + 011)* (00 + 010)]* 


а, = [0 + (1 + 011)* (00 + 010)]* [since Х · А = К] 
substitute q in q, 
q, 74,01 


=q, 1 (1 + 011)* 01[-q, is substituted] 
q, = [0 + (1 + 011)* (00 + 010)]* 1 (1 + 011)* 01 
since q, is the final state the required regular expression is 
[0 + (1 + 011)* (00 + 010)]* 1 (1 + 011)* 01 


Regular expressions are used in the following. 
* Design of compilers 
* To define languages 


* Declarative Way to express set of strings 


* Validation - i.e., checking the correctness of inputs. 
* Tokenisation - i.e., conver: 
later interpretation. 


* In pattern matching 


sion of string of characters into à sequence of words 


* Test (ог a pattern within а string. 

* Replace text in a document 

* Extracta substring from a String based upon a pattern match 
Used in languages like Jscript and C for string handling 
Helps in implementing complex match logic in databases. 


Pumping lemma is a method of pumping (generatin, 


Е) many input strings from a give 
string. It is used to show that cer 


tain languages are not regular, 


* vE 
* [|uv| sn 
then uv'wis in L fori» 0 
Proof: Let M = (Q, E, 8, qy 
by M. 


Let X-0,0,0, a. 


Where m 2 n and each а, is in X. n is the number of states of the finite automata, 


Since we have m input symbols, naturally we should have m+1 states in the | 
Sequence qy q, qp Vn 


Where q, will be the start state and q, will be the final state as shown below. 
ОБОО 


Since |х| > n, by the pigeon hold principle it is not possible to have distinct transitions, One 
о 1 


f the state can have а оор. Let the string x be divided into three substrings as shown 
below. 


F) bea finite automation and L be the regular language accepted 


X =uvw 


Where 
и =a,a,____a, prefix from a, a, ..... a, 
у =а,„а,,---@,„ a, loop string from а, а, -- -3j 9) 
W 20,0, Aw suffix from a,,, а,,---@„ 


from the above figure, it is clear that the prefix string u takes the machine from q, to q, the 
bop string v takes the machine from q, to q, [q, = [A] and suffix string w takes the machine 
from q; to q,,. 


The minimum string that can be accepted by the above FA is uw with {= 0. 
But when i = 1, the string uvw is accepted by DFA. 
When i = 2, the string uvvw is accepted by DFA. 


$0, > 0, the machine goes from q, to q, оп input string и, circles from q,to q, based on the 
value of i and then goes to accepting state on input string w. In general, if the string x is split 
into substrings uvw, then for all i > 0, 


uv weL 
This can be expressed using the following transitions. 
5 (qy а, а, 2,,8,0,,0,,,---0,) =5(5 (Ч, а, а,---а,, а), ao а,.,---а,) 
=5 (4.4.1 а,., ---а,) 


= 8 (Qy Ası а,.,---@,) 


=g 
Also, after the string a, a, ____а, the machine will be in state q, Since 4, and д, are same, 
we can input the stringa, а, ----а, апу number of times and the machine will stay in 


1 only. Finally if the input stringisa,, 2,, ---4, the machine enters into final state д,„. 


Pumping Lemma can be sued to prove that certain languages are not regular. 


Step 1: Assume that the language L is regular. Let n be the number of states in tl 
corresponding FA. 


Step 2: Choose a string ‘x’ such that | x | > n. Use pumping lemma to write x = uvw wil 
the constraints 
* Vse,|v| 21 
* [uv| sn 

Step 3: Find a suitable integer i such that u v'w € L. According to pumping lemma, u vi 
is іп L for i > 0. So, the result is contradiction to the assumption that the Іаприарей 
regular. 


Therefore, the given language L is not regular. 


Рповієм 1 


Show that L = {w w*|w e (а + b)*) is not regular. 


—— qD — — 


Step 1: Suppose L is regular. Let n be the number of states in the FA accepting L. 
Consider the string 


R 
w w 


————— 
х=а ab b b... ba...a 
Where w=a___ab band reverse of w, w° = b. ba___a 


Step 2: Since | x | > n, we can split the string x into uvw such that /uv/ < n and /v/ 2 1 
МЕ 7 AEN ТЕҢ 
ааа auri, асс, 


w 
Where |u| -n-and|v|-1 
So that |uv| = |и| + |v| 


| 
=n-1+1 | 
= n, Which is true. | 
According to pumping lemma, иуи E L fori=0,1,2____ | 


Step 3: If i is 0, that is v does not appear and so the number of a's on the left of x will 
belessthanthenumberofb'sontherightofxandsothestringisnotofthe form ww'| 


Sou vw € L, when i 0 


This is a contradiction to the assumption that the language is regular. So, the 
language 
L = {ми | w € (a + b)*} is not regular. 


— — arm 


Show that the language [L,] consisting the strings with an equal number of 0's 
followed by equal number 1's is not a regular language. 


OR 
Prove that, L, = (0^ 1" | nz 0) is not regular. 


| К ={01,0011,000111,____} 
| Step 1: LetL, be regular and n be the number of states in FA. Consider the string, x 0^ 1". 
Step 2: Since |х| -2n2 n 
we can split x into uvw such that |uv| < n and |v| 2 1 
х=000 0 1111 
ыйл. Mes ATA b 
uv w 
where |и| 2n-1and|v|- 1 


so that |иу|= |u| + |v| 


=n-1+1 


and [и] 
According to pumping lemma, и vw € L for i = 0, 1,2,___. 


Step 3: If i is 0, the string v does not appear and so the number of 0's will be less than the 
number of 1's and so that string x does not contain n number of 0's followed by n 
number of 0's followed by n number of 1's. 


But, according to pumping lemma, n number of 0's should be followed by n number 
of 1's, which is a contradiction to the assumption that the language is regular. 


So, the language 


L,, ={0"1"|п> 0) is not regular. 


Theory of Computation 


Prosiem 3 


Show that the language, L = (a^ |K is an integer, k 2 1) 


Which consists of all strings of a's whose length is a perfect square, is not regular. 


— a 


Step 1: Let L be regular and n be the number of states in FA. Let us choose the value of 
which depends on n. 


Thatis, Let x = a" ЕЁ Where т = n? 


Step 2: Note that |x| 2 n and so, we can split x into uvw such that |uv| < n and |v] 2 1a 
shown below 


Where |u | =] and |у | = К> 1 and so |uy| = |u| + lvl =j+ksn 
Step 3 : According to pumping lemma, и v'w € L, fori=0,1,2,___ 
і.е., аа“ ат! L for i=0,1,2___ 
Now, if we choose i = 2, we have 
uv'weL 
a! а? a"* ЕЁ | 
ает 
since К 2 1, ме have 
la"**| =m+k 
= п? + К (since m = п?) 
Note that 
n? «n «k«n'*1(whenk- 1) 
< (п2 + 2п + 1) = (п + 1)? 
son? < (п + 1)? 


Since п? + k (nothing but m + K) lies between п? and (n + 1)’, itis nota perfect squar 
which is contradiction to the assumption that it should be a perfect square. 


So the language 


L= {а | kis an integer, К> 1) is not regular. 


Show that L = {w | n, (и) = n, (w)} is not regular 


— — SES» ——— 


The language consists of the strings with an equal number of a's and b's 


lle, 
Step 1: 


Step 2: 


Step 3 : 


L ={€, ab, ba, abab, aabb, bbaa,_____ } 
Let L be regular and n be the number of states in FA. Let us choose the value of x 
which depends on n. 
Let х =a" ЕЁ 
Note that |x| = 2n > n and so, we can split x into uvw such that |uv| < n and |v| > 1 as 
shown below 
х=а" 
Where |u| = and |v| =k 2 Тапа so that |uv| = |u| + |у| 2j * ks n 
According to pumping lemma, uv we L fori=0,1,2,____ 
ie, a (a) b" €Lfori-0,1,2, — 
Now, if we choose i = 0, the number of a's will be less than the number of b's and 
if we choose i = 2, uv’w will have more а’; than b's which is contradiction to the 
assumption that it has equal number of a's and b's. 
$о {һе language 
L = (wn (м) = n,(w) ) is not regular. 


— — ar 


Show that L = ( w|n (и) < n, (w) ) is not regular. 


— — Фаина —— — 


The language consists of strings a's and Б, where the number of a's is less than the number 


of b's. 
Step 1: 


Step 2: 


Let L be regular and n be the number of states in FA. Let us choose the value of x 
which depends on n. 
Let xz-a"nbeL 
Note that |х| 2n - 12 n 
we can split x into uvw. 
Such that |uv| < n and |v| > 1 as 
zar 


-a bb. 


Step 3: 


where |u| =n- 1and|v| =K 


luv| = [м] + |v/ = nr + Ks n 
In this case the value of K should be less than or equal to 1. 
According to pumping lemma, и vw € L for i = 0, 1, 2, 
ie., a"! (b*)! b™* € L for i = 0, 1, 2, 
Now, if we choose i = 0, 
a"! bk EL 
and when k= 1, а"! b^* EL 


So when i = 0, the number of а" and b’s are same, which is a contradiction t 
the assumption that the number of a’s will be less than the number of b’s. So, th 
language L = (w|n,(w) < n, (w)} is not regular. 


Show that = { a' b' | i > j) is not regular 


—_ li — — 


The language consists of strings of a's and b's, where the number of a's are more than tht 
number of b's. 


Step 1: 


Step 2: 


Step 3: 


Let L be regular and n be the number of states in FA. Consider the string | 


x =a" pe 
Since | x | = 2n*1 > n, we can split x into uvw such that [иу| < n and || 2 1 | 
x=a"'p" | 

=a! a! ab" | 


where |u| =jand |v| = k2 1 | 
luv| = |и| + || 2j + k sn 

According to pumping lemma, 

uvweLfori20 

ie. @ (a)! a b^ eLforiz0 

Now, if we choose i = 0, number of a's in string и will not be more than number of 


b's in w, which is a contradiction to the assumption that number of a's are more 
than the number of b’s. 


So, the language 
L -(a'b/|i»j)isnotregular 


Prosiem 7 


how that = { a" / п > 0) is not regular 


——SENP — — 


п! =1*2*3*___n 

Step 1: Let L be regular and n be the number of states іп FA. 

Step 2: Let x =a" 

Itis clear that |x| > n. 

So we can split x into uvw, such that |uv| < n and /v/ > 1 as shown below 


where |u| =jand |v| = k2 1 
luv] = м + М =/+К5 n 
Step 3: According to pumping lemma, и vw € І,Хогі= 0, 1, 2,____ 
ie, a (avian EL 
if iz0 
a a" ЕЁ 
а! ЕЁ 
Itis very clear that n! > п! - К 
when К = 1, л! > л! – 1 


But according to pumping lemma, n! = n! - 
L can not be regular. So, the language, 


L = {а" | nz 0) is not regular. 


show that L = (0"/n is prime) is not regular 


—— SAI  — 


Prime numbers аге 1, 3, 5, 7, _____ so the language, L = (0, 000, 00000, ____- ) 
Step 1: Let L be regular and n be the number of states in FA. 
Let x = 0" €L, where n is prime. 


Step 2: |x| =n 
Therefore we can split x into uvw such that /uv/ < п and /v/ 2 1 as shown below. 


1 which is not and is a contradiction. So 


x=0" 


=0/ 0* or s* 
EM 


where |u| =jand |v| = k21 
luv| = [м] + |У| 2j * k s n 
Step 3 : According to pumping lemma, u v'w € L for i= 0,1,2 . 
Le. O (0)! 0" € L 
ie,  j*ki*n-j-kzn*k(i- 1) is prime for alliz0 
If we choose i = п + 1 then 
п+К (1 - 1) =п+ Кп 
=n(k+1) 
is also a prime for each k 2 1 which is a contradiction, because if k = 1 it will not bd 
a prime. 


So, the language L = {0" | n is prime} is not regular. 


— — eum ——— —— 


Show that L = {ww|w c (a, b}*} is not regular. 


— — SEND —— — 


Step 1: Let Бе regular and n be the number of states in FA. Let r us choose the value oft) 
which depends on n. 


ie, x -a"ba"beL 


Step 2: Note that |х| = 2n + 2 > n and so we can split x into uvw such that |uv| < n and |v] 21) 
as shown below | 


x=a"ba"b 
=g! a‘ ba"b | 
where |u| =/апа |v| = К> 1 and so that 
luv] = [4] + [| 
=]+К<п 
Step 3: According to pumping lemma, u v'w € L for i 0, 1,2 
ie, a (a! ba"b € L fori=0,1,2,____ 
Now if we choose i = 0, number of a's on the left of first b will be less than the 
number of a's after the first b which is a contradiction to the assumption that they) 
are not equal. 


So the language L = { ww|w € {a, b}*} is not regular. 
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The regular languages exhibit two types of properties. They are 
1. Closure properties. Ex.: Union, Intersection, etc., 
2. Decision properties. Ex.: Whether 2 Finite Automata accept same languages or not. 


111 


Some new languages can be constructed from already existing languages using certain 
operations such as union, intersection, concatenation etc. These properties are called 
dosure properties. They are 

* Union of two Regular languages is regular 

* Intersection of two Regular languages is regular 

* Complement of a Regular language is regular 

* Closure of a Regular language is regular 

* Concatenation of two Regular language is regular 

* Difference of two Regular languages is regular 

* Reversal of Regular language is regular 

* Ahomomorphism of a Regular language is regular 

* The inverse homomorphism of a Regular language is regular 


(a) 


(b) 


Regular Languages are closed under Union, Intersection and Star (closure) 
Theorem 2.3 : 


Show that if L, and L, are regular then L, U L, L,- L, and L,* are also regular 
languages. 

Proof: It is given that L, and L, are regular languages. So, there exists regular 
expressions А, and R, such that L, = L (R,) L, = L (R;) 

By definiton of regular expressions we have 

+ R,*R,isaregular expression denoting the Langauge L, U L,. 

* R,R,isaregular expression denoting the language L, · L, 

* R,* isa regular expression denoting the language L,* 

So regular languages are closed under union, concatenation and closure 
operations. 


Closure under complementation: 
Theorem 2.4 
Show that if L is a Regular language then complement of L is also regular. 
Proof: Let M, = (0, £, 6, q, F) be a FA which accepts language L. 
М, = (Q, ©, 8, qy Q - F) be а FA which accepts language L which is a 
complement of language L. 


(c) Closure under Intersection. 


(d) 


Since the final state of M, is the non-final state of M, and non-final state 


of M, is the final state of M,. There exists М, which accepts Г. So I is 
also Regular language. 


L = ( All words with length of atleast two and second letter as b запах = (a,b) 
L = (All words with length less than two or second letter not b } 


Let M, be the FA which accepts L Then M, is the FA which accepts L 


| 
Therem2.5: ShowthatifL, and L, are Regular then itis closed under Intersection, 


Proof: L and L, are regular languages. Let L = LL, | 
Applying De morgan’s theorem 


| 

| 

LoL-LnL ЕП = LUG) | 
Since L,, L, is regular 

> Ia д is regular [> regular sets are closed under complementation] 


=> L,UL, isregular [> regular sets are closed under union] 


= L UL, is regular [> regular sets are closed under complement] 
= L,nL,isregular (By demorgan's law) 

So regular languages are closed under intersection. 

Closure under difference 

Theorem 2.6 


If L, and L, are regular languages then the regular languages is closed under 
difference. (i.e.,) L, - L, is regular. 


Proof: 
Since L,, L, is regular language, then L, is also regular, 
=> LNA M isalso regular. [> regular languages are closed under intersection] 


= L-Misalsoregular [:L- M-Ln M] 


(e) Closure under reverse 


Case 1: 


Case 2: 


Case 3: 


Theorem 2.7 
If L is regular L° is also regular. 
Proof 
Let L be the regular language corresponding to regular expression E. 
It is required to prove that there is another regular expression E* such that 
L (E^) = (1 (Е) 
Basis 
By definition of regular expression E, 
e ġ isa regular expression 
* Єіѕ a regular expression 
* ais a regular expression 
So the reversal of regular expression Е" is given by 
* (6*-(9) * {Е} = {є} > (ay ={а) 
Induction 
By definition of regular expressions, if E, and E, are regular expressions then, 
* E, + E, isaregular expression 
* E, E, is a regular expression 
* E,*isaregular expression 
which results in three different cases. Let us prove each of these. 


If E = E, + Е, is a regular expression then E" = Ef + Е? isa regular expression 
denoting the language L (E") = L (Ef) о L (ЕЯ) 
If E = E, - E, is a regular expression, then E" = Ef + E? is а regular expression 
denoting the languages L (E°) = L (Ef) - L (E7) 
If E =E; isasregular expression then E^ -(E; )* isaregularexpression denoting 


the languages L(E")=L((E;)*) 


Closure under Homomorphism 


Let апа Г be the set of alphabets. The homomorphic function 


й: 5 ы 


is called homomorphism (i.e.,) a substitution where а single letter is replaced Бу a string. If 


м=а, а, а,____а, 


h(w) = (a) һ (a) h (a) -h (a) 


If Lis made of alphabets from $, then h (L) = ( h (w) | w E L } is called homomorphic image. 


Theorem 2.8 


A Decision property for a class of language is an algorithm that takes a formal descripti, 
of a language and tells whether or not some property hold. 


(i) Whether the language is empty 

(ii) Whether the language is finite 

(iii) Whether the given string belongs to the language 

(iv) Whether the language a subset of another regular language 

(v) Whether the language is same as another regular language 
Let us proof some of the decision properties. 
(i) Whether the language is empty (i.e) L = ф. 
Use DFA representation. Use a graph reachability algorithm to test if atleast 
one accepting state is reachable from the start state, 
(ii) Whether the language is finite, 


from the start state and all the states that do not reach accepting states, 
Test if any cycle exists, if so L is infinite otherwise L is finite. 


as another regular language. 
This can be proved with minimal finite automata, 


Given FA create a new FA with a minimal number of States that accept the same 
language. Generate minimal automata for each FA. Then compare ona state by state | 
basis. 


For storage efficiency, it is desirable to represent the DFA with fewer states, hence it is | 
required to minimize the DFA. The minimization of finite automa is very important in 
the design of switching circuit, as the number of states of the automa implemented by the 


circuit decreases, the cost of the circuit also decreases, 


Minimization of automa can be achieved by finding distinguishable and indistinguishable 
States. 
Equivalence of two states: Two states P and q are equivalent (indistinguishable) if and 
only if 5 (P, w) and 6 (q, w) are final states or both ô (P, w) and 6 (q, w) are non final states 
for w € E* (i.e.)) if 8 (P, w) € F and 6 (q, w) € For 6 (P, w) € Fand 6 (q, w) € Fthen the states 
Pand q are indistinguishable. 
Ifthereisatleastone string w such that one of (Р, w) and 6 (q, w) is final state and the other 
isnon-final, then the states the states P and д are distinguishable (unquivalent) states. 
Table Filling Algorithm: Table filling algorithm is used to find set of states that are 
distinguishable and indistinguishable. 
The algorithm is recursively defined as follows. 
Step 1: For each pair (р, q) where p € Q and q € Q, if P € F and q € For vice versa, then the 
pair (p, q) is distinguishable and mark the pair by putting Ж. 
Step 2: Identify the subsequent markings 
For each pair (р, q) and for each a € F find 8 (p, а) = r and б (p, a) = S. If the pair 
(r,s) is already marked as distinguishable and mark it as ike 
Repeat step 2 until no previously unmarked pairs are marked. 
Step 3 : Ifthepair(p,q) obtainedusingtheabovetablefillingalgorithmareindistinguishable, 
then the two state P and q are equivalent and they can be merged into one state. 
Minimization of DFA: The algorithm to minimize the DFA is as follows. 
Step 1: Find distinguishable and indistinguishable pairs using the table filling algorithm. 
Step 2: Obtain states of minimuzed DFA wihch includes both indistinguishable pairs and 
distinguishable state. 
Step3: Compute the transition table. 
If [P,, P... P,] isa group and if ([Р,, Pp ---- P} a) = [ry ry г] then place 
an edge from [P,, Pp -PJ to [Fp ry» ---- г] and label the edge with the symbol 
a. Follow this procedure for all the states obtained in step 2 for eacha€ X. 


Reduce the DFA 


The transition table of the above DFA 


The DFA can be minimized using table filling algorithm. 
The various states of the DFA аге А, B,C, D, Е. 
Step 1: 
(а) Draw the table 
(i) Vertically write all the states from second state to last state like B, C, D, 
(ii) Horizontally write all the states from first state to last but one state like 


* 


A|[B|C|D 
(b) Initial Marking 
Since E is the final state, the pairs (A, E), (B, E), (C, E), (D, E) has one final stat; 
and other one non-final state. So, the pairs are marked horizontally. 


B 

[4 

D 
grararaear: 
ВТС 


А 
Step 2: Subsequent marking 


For each pair (p, q) and for each a € X find 6 (p, a) = rand 6 (p, а) = s. If pair (r, 5)% 
already marked as "distinguishable" then pair (p, 4) is also distinguishable state 
and mark it as ‘x’, 


(D, E) is marked, so mark (A, B) 
(D, E) is marked, so mark (А, С) 
(D, E) is marked, so mark (A, D) 


(B,D) | (CC) | (EE) 
(CD) | (ВС) | (EE) 


Ex 556 0 1 
£ = (8,0) | (СВ) | (EB 

* [e| Б] (вр) | (со | (ЕЕ 
А[в[с[р| (Ср) | (&O | (EE) 


Repeat Step 2 

Since there is no further marking, stop the iteration. 

Indistinguishable pairs (B, C) (B, D), (C, D) = (B, C, D) 

Distinguishable states = A, Е 
Step 3: Obtain the states of minimized DFA 

А, (B, С, DLE 

Step 4: Identify the start state 

Since A is the start state of DFA, A is the start state of minimized DFA. 
Step 5: Identify the final state 

Since Е is the final state of DFA, E is the final state of minimized DFA. 
Step 6: Compute the transition table 


5 0 1 
ES (B.GD) | {B,C D} 
(B.C D) | (CD) E 
+E E E 


Minimized DFA is shown below 


the equivalent 


Minimize the following DFA 


— a 


The states q, and 4, are not reachable from start state. So they have to be removed. 
The various states of the DFA are 9 9 9 qy The transition table of the DFA is 


Step 1: Draw the table Step (ii) Initial marking 
а; 
СА 
М 
% |9, | d; 


* 


Since q, and q, are final states, mark the pairs (qy 9,), (а, 4,) (9, q,), (9, q,). Do not тай 
(q,, 4,) Since both are final states. 


d, 
* 9, |х х 
* 9 |х |x 


9 | 9, | 9 


* 


Step 2: Subsequent marking 
5 | 0 | 1 
(49) | (4,4,) | (4,4,) | 


There is no further marking, so we сап stop the iteration. | 
Indistinguishable pairs = (454,) (9, 9; ) 
Distinguishable state = Null 

Step3: Obtain the states of minimised DFA (404, {9,,9,} 

Step 4: Identify the start state | 


Since q, is the start state of DFA, the pair ( qo 9, ) is the start state of minimized 
DFA. 


Step 5: Identify the final state 


Since q, and q, are the final states of DFA, the pair (4, 9) is the final state of 
Minimised DFA. 


Step 6: Compute transition table Minimized DFA is shown below 
eae 
2(4,4) | (4,4) | (4p 45) 
{dy 4) (99) | {445} 


find the minimized DFA from the following transition table 


DE осу TST © > Bla 
© бу їр “у > BA >|/= 


шота 


—— q — — 


The various states of the DFA re A, B, C, D, E, F, G, H. 
Step 1: Draw the table and do initial marking. 


Since D is the final state, the pairs (D, E), (D, F), (D, G), (D, H) are marked vertically 
and (A, D), (B, D), (C, D) are marked horizontally. 


B 

= = 
“Бх |x |x 

E x 

F x 

G x 

H x 
BELDGEEGB 


Step 2: Subsequent marking 

5 а b 
(А, B) (В, А) (А, С) 
(BD) | (AB) |(B,D) is marked, so mark (A, C) 
(B, D) (А, Е) |(В, D) is marked, so mark (A, E) 
(AF) | (ВС) | (AE) | 
(AG) | (ВЕ) | (AG 
(В, С) (А, D) |(А, D) is marked, so mark (A, Н) 
(A, D) is marked, so mark (B, C) 
(A, D) is marked, so mark (B, E) 


(B, G) (А, Р) (С.С) 


(А, С) (€ D) |(C р) is marked, so mark (В, Н) 
(СЕ) (DD) | (BF) 


(D, G) is marked, so mark (C, F) 
(D, F) is marked, so mark (C, G) 
(D, G) is marked, so mark (C, H) 
(D, G) is marked, so mark (E, F) 
(D, F) is marked, so mark (E, G) 
(D, G) is marked, so mark (E, H) 


(Е, D) is marked, so mark (Е H) 
(G, D) is marked, so mark (G, H) 


B 

сх |x 

рух |x |x 

E|x |x x 

F x |x |x 
G| х |x |x | 
Н |х |x |x |x |x |х |x 
A|B|C|D|E| FIG 


Repeat step 2 and find subsequent marking. 
b 
(А, С) | (A, C) is marked so mark (A, B) 
(А, Е) |(A, Е) is marked, so mark (А, Е) 
(А, С) 
(С, E) 
(С, G) |(C С) is marked, so mark (B, С) 
(В, Е) 
(Е, G) | (Е, С) is marked, so mark (Е С) 


Update the new marking into the table. 


В |х 

С |х |x 

*|Dix |x |х 

Е |х |х х 

Е |х х |x |x 
G x |х |х [x |х 
Н |х |x |X |x јх |x jx 
АВС ВЕ ЕС 


* 


Repeat step 2 and identify further marking. 
6 a b 
(4,6) (ВР) | (A6) 
(B, F) (4, G) (С, E) 
(СЕ) (D, D) (В, F) 

Since there is no further marking, we can stop the iteration. 

Indistinguishable pairs = (А, С), (В, Е), (C, E) 

Distinguishable states = D, H 
3ep3: Obtain the states of minimised DFA 

(4, 6), {B, Е}, (C E), D, H 

Sep4: Identify the start state. 

Since A is the start state, the pair (A, G) is the start state of minimized DFA. 
Мер 5: Identify final state. 

F-(D) 


Step 6: Compute the transition table. 


5 а b 
246} | {B, F} (4^6) 
(В, F} | {АС} {С E) 
(CE | D {В, Р} 
*р D (А, б} 
н lu a [5 


Minimized DFA is shown below 


Since the state 

H is not 
reachable from 
the start state, 

it can be removed 


Minimize the following DFA 


пов ш — mom on тј 


~IA "* 5 OC o6 Dal 
> Ж сурш оо сша 


— — amm 


The various states of DA are А, B, С, D, E, F, G, Н, I 

Step 1: Draw the table and Do initial markings 

* ForthestateC, the pairs (D, C), (E, C), (G, C) and (H, C) are marked vertically and 
(A, C) and (B, C) are marked horizontally. 

* For the state F, the pairs (G, F) and (H, F) are marked vertically and (A, F), 
(B, F) 

* (D, Е), (Е, Е) are marked horizontally 

* For the state I, the pairs (A, I), (B, I), (D, I), (E, I) (С, I) and (Н, Г) are marked 
horizontally. 
Do not mark the pairs (C, I), (C, Е), (Е 1) as С, Е I all are final states. 

x 

x x 


= =|о| о 
х 


AJ[B|C|D|E|F|G|H 


* * 


: Subsequent marking 


(B, C) is marked so mark (A, B) 


(B, F) is marked so mark (A, E) 


В, C) |(B, C) is marked, so mark (А, Н) 
(C, E) is marked, so mark (B, D) 


(C, H) is marked, so mark (B, G 


(H, I) is marked, so mark (D, E) 


(E, I) is marked, so mark (D, H) 
(Е Н) is marked, so mark (E, С 


(С, B) is marked, so mark (Н, С 


Update the new marking into the table 


x 


Xxx 


A|B|c|D|E|F|G|H 
г 


ж 


repeat step 2 to identify further marking 
б а b 
(4, D) (B, E) (B, H) 
(4G) | (&H) (В, B) 
(B, E) (СЕ) (ЕГ) 
(B, Н) (GT) (E C) 
(0,6) | (ER) (H, B) 
(Е, Н) (ED (, С) 
Since, there is no further marking, we can stop the iteration. 
Indistinguishable pairs are 
(A, D), (А, б), (D, б) = (A, D, б) 
B, E), (B, Н), (E, H) = (B, E H 
С, F), (С, 1), (E I) = (C, E, I) 
distinguishable states does not exists. 
Step 2: The start states of minimized DFA are { А, D, G GL (B, E H LG EI) 
Step 3: The state of minimized DFA - (AD,G) 
Step 4: The final state of minimised DFA = (GEI) 
Step 5: Compute the transition table 
ШШ: а b 
2(ADH) | {ВЕН} (B EH) | 
{ВЕН} | (GEI). | (GEI) 
*(GEI) {A D, H} {ВЕН} 


Minimized DFA is shown below 


(heck whether the following two DFA's are equivalent. 


First we will reduce the DFA D1. 


8 Ta[5 

mq, [а |9, 

| a [ala | 
а | % | 4% 


The various states of DFA D1 are q, q, q; 
Step 1: Draw the table and do the initial marking. 


Since q, is the final state, and q, q, are non final states, the pairs (9,,9,), (q, 4,) are 
marked vertically. 


q | х 


Gs. | * 


КД % | 


T (4, 4,) is marked so mark (9,93) 


Update the new marking into the table. 


% | х 
9, | X | x 
Ч, | Q 


* 


Since there is no further marking, we can stop the iteration. 


From the table, we can notice that there is n 
cannot be reduced. 


Reduce the second DFA D2. 


o Indistinguishable pairs. So the D} 


5 a b 
na 4, 4; 
LH L^ 9, 
LA 4; LA 
4; ГА 4, 


The various states of DFA D2 are 9,95 9 9 
Step 1: Draw the table and do the initial marking. 


Since q, is the final state and q, qy 9, are non final states, the pairs 
(9,, 95), (9,,9,), (4, q,) are marked vertically. 


4 | х | 
а, | х | 
а, | х 

114 [9% | 4% 


* 


Step 2: Subsequent marking 


(4,4,) | (44 ) | (4, q,) is marked so mark (45%) 
om 


(9,,9,) 


(4, 9,) is marked so mark (4, 4;) 


Update the new marking into the table 


арх 

|х|х 

$ lx x 
a, | Ws | 9 


* 


Repeat step 2 to identify further marking 
a b 
(4,4, | (99) | (2,4) 
Since there is no further marking, we can stop the iteration. 
Indistinguishable pairs аге (q., q,) 
Distinguishable states are q, q, 


Step 3: The states of minimised DFA 0; are q, 99,9 
Step 4: The start state of minimized DFA D; = (q,) 

Step 5: The final state of minimized DFA D; = {q, } 

Step 6: Compute the transition table of minimized DFA Dj. 


* 
UTR 


(9,9) 


Since all the transitions and states of DFA D, and Dj are similar, we can say that the given 
DFA D, and D, are equivalent. 


Prosiem 6 


Check whether the following DFA's are equivalent. 


From the previous problem we know DFA D, cannot be minimized further. Let us reduce 
DFA D2. 


The various states of DFA D, are q, qy q,, 9, 
Step 1: Draw the table and do initial marking. 

Since q, is the final state and q, q, q, are non final states the pairs 
4, 95), (9,9), (qy 9,) are marked vertically. | 


9; | х 
9, x | 
Ex x ae 
4, | d; | 9, 


Step 2: Subsequent marking 


b 


| (do 9) is marked so mark (q., q;) 


Update the new marking into the table. 


9. |х 
14 | х 
14. 
q, | 4; | 9, 


Repeat step 2 to identify further marking. 
a b 

(asa) | (4,4) | (9.9. 
Since there is no further marking, we can stop the iteration. 
Indistinguishable pairs are (q., q,) 
Distinguishable states аге q, 4, 


Step 3: The states of minimized DFA D; are q, (qy q,), 9 
Step 4: The start states of minimized DFA Dj = {q} 


Step 5: The start states of minimized DFA Dj = {q,} 


Step 6: Compute the transition table. Renaming the states 
6 | a b q, as А 
nat ^ а, (4, 4) {dya} as В 
чәч) | % {as 4) d ES С 
4; {4,91 9, 
The transition table becomes 

5 а b 

—*A A B 

B [4 B 

[4 B A 


Since the transitions of DFA D, and D; are different, we can conclude the given DFA 


D, and D; are not equivalent. 


For the DFA D, Ais the final state and B is non-final state, which are not equal. So DFA D, 
can not be minimized. 
Let us reduce DFA D,. 


Step 1: 


Step 2: 


Step 3: 
Step 4: 


Step 5: 
Step 6: 


5 0 1 
КС. р Е 
*D D E 
E C E 


The various states of DFA D,are C, Dand E 
Draw the table and do initial marking. 


Since C and D are final states and E is non final state mark the pairs (C, E) and 
(D, E). Do nót mark (C, D) as both C and D are final states, 


«12 
Е|х|х 
C|D 
| 


* = 
| 

Since both C and D are final states. 

States there is no. subsequent marking and we can stop the iteration. 

Indistinguishable pairs are (С, D) Distinguishable State Е. 


The states of minimized DFA D, are (C, D), E 
The start state of minimized DFA Di - (C, D) 


The final state of minimized DFA D, = (C D) 
Compute the transition table 


Renaming the states 
(С, D) as q, 
Easq, 
The transition table becomes 


Since all the transitions and states of DFA D1 and Dj are similar, we can conclude 


that the given DFA D, and D, are equivalent. 


Minimize the following DFA 


The transition table of the above DFA 


5 а b 

24 4, | d, 
°ч, a, 4, | 

“а, 15 


The various states of the DFA are qy qy d; 
Step 1: (i) Draw the table 


* а, 
"ja, 


19 14 J 


(ii) Initial Marking 


Since q, and q, are the final states mark the pairs (q, 9,) since both are final sta 
* 


а |x 

ole 7 
q, |4 

4, la 


* 


Step 2: Subsequent marking. 


Both q, and q, are final states of there is no further marking, 
iteration. 


Indistinguistable pair = (9, 9,) 

Distinguishable state = [^ 
Step3: Obtain the states of minimized DFA qy {9,,9,} 
Step 4: Identify the start state q, is the start state of minimized DFA. 
Step5: Identify the final state . 


Since q, and q, are the final states of DFA, the pair (4, 9,) is the final state of 
minimized DFA. 


so we can stop thi 


Step 6: Compute the transition table Minimized DFA is shown below 
8 | a b 
эв, (4,4) 9 
“dy a) {9,9} — (4,4) 


PRoBLEM 9 


Minimize the following DFA 


| 
| 
| 


The transition table of the above DFA 


The various states of the DFA are qy Ч, q, 93,9, 
Step 1: Draw the table with initial marking 


a, | 
СА 
d; 
* ige |t x x x 
9 a, 4, 19: 


Step 2 : Subsequent marking 

à a |b 
(99) (99) | (a ТА) 
(a, 4„) 


(4„ q,) is marked. So mark (q q,) 


(4„ q,) is marked. So mark (q, q,) 
(4„ Ч.) is marked. So mark (q, q,) 


a, 

q, 

a] e g 
z * [x 


9, |X |х 
d, |a |a |a 


Repeat Step 2 : 
5 а b 


(4„ 9,) is marked. So mark (qy 9,) 


(qy q;) is marked. So mark (q, q,) 


LM x 
q, x 
q, |х x x 
* ig, [x on x 
a 1% 19, 19, 
Repeat Step 2: 


nce there is no further marking, stop the interation. 
Indistinguishable pairs : (9, 9) 
Distinguishable states : d, Qs Q, 
Step 3 : Obtain the states of minimized DFZ 
{Ч I} 4, Ч» 9, 
Step 4 : Identify the start states 
Since q, is the start state of DFA, the pair (q,, 9,) is the start state of minimized DFA 
Step 5 : Identify the final state. 
Since q, is the final state of DFA, q, is the final state of minimized DFA. 


Step 6 : Compute transition table Minimized DFA is shown below 
5 а b | С 
> 14.4) |4, (4,4, 
9, 4, LE 
qs q, q, 
q а, (4,9) 


Minimize the following DFA 


5 0 1 
эф, q, 9, 
4, СА 4; 
9, q, ЕЛ 
* ч, 4, СА 
°ч, а, а, 


95 d; qs 


— — q — — 


The various states of the DFA are qy q, q, 9. @„ 4s 
Step 1: Draw the table with initial marking 


1% 
4; 
hg x х х 
* Iq, |х x x 
д х х 
4. 1% 19 1% 19 


Step 2: Subsequent marking 


ý (4„ q,) is marked. So mark (q,, q,) 
(ay q,) is marked. So mark (qy 9,) 
(4„ 4,) is marked. So mark (qy q,) 


(ay 4) 
(4, 9,) 
(9, 9.) 


(9,9) 
(9,9) 
(9, 9.) 


4, |a, 


Repeat Step 2: 


5 a b 

(4) 4.) (9, 9,) (4 4,) 
(4, q.) (9, 4.) (a, 4,) 
(4, 9.) (q, 4.) (4,4) 


Step 3: The state of minimized DFA 


4 (a, I 95), {4y 4) 
Step 4: q,is the start state of minimized DFA 


Since there is no further marking, we 
stop the iteration. 


Indistinguishable pairs : (q,, q,), (9, $ 
(a, 4.), (93,9) 


= (4, 4„ 4), Gy 94) 
Distinguishable state : % 


Step 5: Since q, and q, are the final states of DFA, the pairs {q,, q,} is the final state 


minimized DFA 


5 а b 


>A (v d» 4) | (2,4, 95) 


(9,99) | (9,9,9) |(2,4,) 


*(9,9,) (ay q,) (ay 44) 


Step 6: 


—— qD 


sition table of the above DFA 


8 [а b 
3*1 3 2 
2 4 1 
3 5 4 
4 4 4 
* 85 3 2 


p2: Subsequent marking 


The various states of the DFA are 1. 7, 3, 4, 5 
Step 1: Draw the table with initial marking 


2 


3 
4 x 
5 


(1, 4) is marked. So mark (2, 3) 
(1, 4) is marked. So mark (2, 4) 
(5, 4) is marked. So mark (3, 4) 


2 x 

3 x x 

4 x x x x 

5 x x x 
1 2 3 4 


Step 3: Obtain the states of minimized DFA 


{1, 5}, 2,3, 4 
Step 4: Identify the start state 


Since both 1 and 5 are final states, there is 
no subsequent marking and we can stop the 
iteration. 


Indistinguishable pairs : (1, 5) 
Distinguishable states : 2, 3, 4 


Since 1 is the start state of DFA, the pair (1, 5) is the start state of minimized DFA. 


Step 5: Identify the final state 


Since 1 and 5 are the final states of DFA, the pair (1,5) is the final state of minimized 


DFA. 
Step 6: Compute transition table 
ë a b 
—* {1,5} |3 2 
X 714 (1,5) 


3. [1540-4 
4 |4 4 
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PnosLEM 12 


Minimize the following DFA 


— — 


The transition table for the above DFA is given below 


5 а b 
55, 5, s, 
«5, S 5 
* $ 5, 5, 


Step 1: Draw the table with initial marking 
* [s "adl Both S, and S, are final states, th 
is no further marking 


* |$ 
à S * Indistinguishable pairs : (5,,5,} 
CES r Distinguishable states MS, 


Step 3: Identify the states of minimized 

S, (5,5) 
Step 4; S, isthe start state of minimized ОЕА, 
Step 5: (5, S,} is the final state of minimized DFA 
Step 6: Compute the transition table 


Рповієм 13 


linimize the following DFA 


OoOooro0»0mwwo 
Omomooonmn|- 


— — q — —— 


(Е C) is marked so mark (A, B) 
(B, C) is marked so mark (A, D) 


(B, C) is marked so mark (A, F) 


(Е C) is marked so mark (А, H) 
(С, G) is marked so mark (B, D) 
(C, F) is marked so mark (B, E) 


(С, G) is marked so mark (B, F) 
(С, Е) is marked so mark (B, G) 


(С, Н) is marked so mark (D, E) 


(С, б) is marked so mark (D, G) 
(С, б) and (С, С) are marked so mark (D, H) 
(H, C) is marked so mark (E, F) 


(E C) is marked so mark (E, H) 
(С, С) is marked so mark (E G) 
(С, G) and (G, C) are marked so mark (ЕН) 
(Е, C) is marked so mark (G, H) 


x x [x |x [>x 


m 
E 
x 
х 


+ [х [> [x [x [x 


(B, G) is marked so mark (A, G) 


(Н, С) and (Е Е) are marked so mark (EG) 


Repeat Step 2: 

ё а b 
(A E) | (B.H) | (EF) 
(В.Н) | (6,6) |(СО |Thereisno further marking, so we can stop the iteration. 


(DF)|(CC) |(GG) |Indistinguishable pairs: (А, Е), (В, Н), (D F) 
Distinguishable states: C and G. 


Step 3 : Obtain the states of minimized... 
(A, E), (B, H}, C, (D, Е}, G 
Step 4 : Since A is the start state of DFA the pair (A, E) is the start state of minimized DFA 
Step 5: Cis the final state of DFA, So C is the final state of minimized DFA 
Step 6 : Compute transition table 


è [о |1 

— (AE) |{В,Н} (DF) 
(BH) |G с 
“с {AB} c 
{D, F} C G 


G G (AE) 


Prosiem 14 


Minimize the following DFA 


The transition table of the above DFA 


5 [а b 
=, A B A 
B C D 
* © C D 
* DD C D 
The various states of DFA 
A, B,C, D 
Step 1: Draw the table with initial marking 
B 
* Ix 
*|D |х |x 
[А C 


A |В [С |Indistinguishable pairs : (C, D) 
*  Distinguishable states : А, В 


Step 3: Obtain the states of minimized DFA A, B, (C D) 
Step 4: A is the start state of minimized DFA 


5: Since both C and D are final states of the DFA, the pair (C, D) is the final states of 
minimized DFA 
6: Compute transition table 


5 ја b 
ЭА B A 
B {C D) (C D) 


*(GD) |(CD) (c D) 


— Ean 


Minimize the following DFA 


NN njo 


The various states of the DFA are 1, 2, 3 
Step1: Draw the table with initial marking 


2 
e E: x x 
1 2 
Step 2: Subsequent marking 
ё а b 
(2,2) (1, 3) is marked, so mark (1, 2) 
2 x | Since there is no further marking stop the iteration 
s 3 x x Indistinguishable pairs : null 
1 2 Distinguishable states : 1, 2, 3 


Since there is no indistinguishable pairs, the given DFA can not be minimized further. 


[C 


- Obtain a RE to accept string of a's and b's whose second symbol from the right end is a. 
. Obtain a RE to accept string containing atleast one 0, over X = (0, 1) 

- Obtain a RE to accept a string not ending with 001. 

- Write the properties of regular languages. 

- Write the applications of regular languages 


1. Define regular expressions and write the basic operations of regular expressions wi 
examples. 
2. Prove that there exists a FA to accept the languages corresponding to a RE. 
3. Construct an NFA with e-moves for the following regular expressions. 
(i) (0*1) (2*3) 
(ii) a*b+b*cb 
(iii) ((ab)* + (b + c)*)* 
(iv) (0 +01) 
(v) (a * * b*)d*) + k* 
(vi) 0+0*1 
(vii) (aa)*(bb)*b 
. State and prove pumping lemma for regular languages 
- Show that L = {w|n,(w) - n,(w)} is not regular 
. Show that if L is a regualr languages then the complement of L is also regular 


моил Ф 


. Minimize the following DFA 


А grammar for a computer language is much like that for a natural language ; a set of rule 
for putting things together. Each grammar corresponds to a language. In this chapter ме 
focus on a special type of grammar called context free grammar. Then we discuss about 
push down automata, which is a model of a computer that is more powerful than a finite 
automata. 


In formal language a grammar is a set of production rules. They are also called as language 
generators, which consist of terminal symbols, non-terminal symbols, a starting symbol and 
rules. The rules describe how to form strings from the language alphabets that are valid 
according to the languages syntax. A grammar does not describe the meaning of the strings, 
The validity of a sentence is determined by the grammar of a language. Each language, 
generated by some grammar can be recognized by some automation, 


A grammar is a quadruple, G = (V, T, Р, S) 
Where, Visa finite set of variables or non-terminals 


Tis a finite set of terminals 

Pisa finite set of production rules. Each production is of the following form, 
A~ a, where 

A is a string of symbols from (VU T)* 

a is a string of symbols from (VU T)* 

Sis the start symbol and $ € V. 


Noam Chomsky who is the founder of formal language theory has classified the grammar 
into various categories according to the minimal automation required to recognize them. 
They are: 


* Type 0 grammar (Phrase structured/Unrestricted grammar) 
* Type 1 grammar (Context Sensitive grammar) 

* Type2 grammar (Context Free grammar) 

* Type3 grammar (Regular grammar) 


A grammar G = (V, T, P, $) is said to be type 0 grammar or unrestricted grammar or phrase 
structured grammar if all the productions are of the form a > В where 

a € (Vo T)* and ВЕ (Vo T)* 
Inthis type of grammar there is no restrictions on length of a and f, but a can not be €. 
This is the largest family of grammars which is more powerful than all other types of 
grammars. Any language can be obtained from this grammar. 
The language generated from this grammar is called recursively enumerable language. Only 
Turing machine can recognize this grammar. 


| 
| 
| 
| 


5 5aAb|e 
aA >БАА 
bA >a 


Agrammar С = (V, T, P, S) is said to be type 1 grammar or context sensitive grammar if all the 
productions are of the form a > В 
where, 

«and ВЕ (Vo T)' апа | В |> |“ | 

(іе.,) The length of B 
must be atleast as much as the length of a. It is also known as € - Free grammar, since € is 
not allowed in the left hand side and the right hand side of the production. The language 
generated by this grammar is context sensitive grammar. Linear Bound Automata (LBA) can 
be constructed to recognise this language. 


S 5aAb 


| аА 2bAA 
| A >b 


A grammar G = (V, T, P, 5) is said to be type 2 grammar or context free grammar if all the 
productions are of the form A > a where 


aEe(VuT)* 
and A is a single non-terminal 


The symbol € can appear on the right hand side of the production. 


S —aB|bB|e 
А >аА|а 
В -ЬВ|Ь|Е 


И type 3 Grammar 
The grammar G = (V, T, P, 5) is said to be type 3 grammar or Regular grammar or linear 
grammar if and only if the grammar is right linear or left linear, 
A grammar G is said to be right linear if all the productions are of the form 

A>wB 

or 

А >w 

where A, В are variables and w € T* (i.e) w is string of terminals. 


S эааВ|ЬЬА|Є 
А 2aA|b 
B >bBlale 
A grammar G is said to be left linear if all the productions are of the form 
А Bo 
or 


А >w 
where A, B € Vand w € T* 


S -Ваа|АБЬ|Е 
А -Аа|ь 
В >ЬВ|а|Е 
The language generated from the regular grammar is called regular language and these 
languages are recognised by Finite Automate (FA). 


A context free grammar is a method for (recursively) describing the grammar of a given 
language. It is a set of variables, each of which represents a language. The language 
represented by the variables, is described by primitive symbols called terminals. The rules 
relating to the variables are called productions. 


ACFG, G is formally defined as a quadruple, G = (V, T, P, S) 
where Vis a finite set of variables or non-terminals. 
Tisa finite set of terminals 
Pisa finite set of production rules and 
Sisastart symbol, 5 € V. 
Each production is of the form А > a, 
where A is any single non-terminal and a is any combination of terminals and non-terminals. 


(VT, P,S) 


Where 


The set of all strings that can be derived from a grammar is said to be the language generated 

from that grammar. 

Alanguage generated by a CFG, G is called a context-free language and is donated by L (G) 
L(G) ={w|wisin T*andS2» w} 

ie, if wis a terminal string and w can be derived from S, then w is accepted by the grammar. 


Consider the following grammar, G = (V, T, P, 5) 


Where V ={5,А,В} 
T «(a b) 
5 =5 
P ={5$ > АВ 
А-а 


— 


Bob} 


(36. Theory of С omputation 


Here $ produces AB, and we can replace А by a, and B by b. The only accepted string is ab 


ie, 5 УАВ эавАуа 
2abBob 
“ L(G) =аЬ 
Type Machine ] Grammar 

ш Finite Automata Regular 

I Push Down Automata Context-Free 
1 Linear Bound Automata Context Sensitive 
0 Turing Machine Recursive 


Consider a grammar G = (V, T, P, S) 
Where, V ={5} 

T ={a,b} 

$ =S 

P -(Soas|b) 
Find the language accepted by G. 


Sas Sob S>as 
эаа$ 2ab 
2aaaS 

ааа. as 

"иаа E ab 

Le, Sgt 


+ L(G) =a*b 


Consider the following grammar G = (V, T, P, 5) 
where, V = (5) 

T - (a) 

S =S 

Р ={5әа5|є} 
Find the language accepted by G. 


Context Free Grammars 


— шш» — 


5-Е SoaS S>aS  S—aS 
эає эаа$ эаа$ 


эа эаає aa. ..aS 
2aa ~aa___aa 
ie, S a*e 


> а* 
L(G) =а* 


Prosiem 3 


Р = {5 -аа5|аа} 


$2aa Saas SaaS 
әаааа эаааа5 
эаааа___аа5 
~aaaa___aaaa 


ie, 5 (aa) 
L(G) = (aa) 


find the language accepted by the following grammar. 
G = ({5, Т), (а, b, с), P, 53) 
where, Р = {5 э ат 
TbbT|c) 


— SENEP — 


S>aT SoaT SoaT 
2ac >abbT >abbT 
>abbc >abbbbT 
>abb____bbc 
ie. S —5a(bb)*c 
L(G) =а(аа)* с 


E Theory of C omputation 


PRoBLEM 5 


Consider the following grammar 
5 5aCa 
С -асаь 
Write the language generated by the grammar 


— — SEND —— — 


S>aCa S>aCa S>aCa 
>aba эааСаа эааСаа 
2aabaa >аа___С__аа 


ie, 5 > aba 
L(G) = {а" Ба" |п>1} 


Let M = (Q, E, 5, qy Е) be a finite automata accepting L, A grammar G = (ИТР S) can be 
constructed where, 


V ={ 4.9, ---9,} 
ie, the states of DFA will be the variables in the grammar. 


Т =; 
ie, the input alphabets of DFA are the terminals in grammar. 
S =q 


ie, the start state of DFA is the start symbol in the grammar. 
The productions P from the transitions can be obtained as 
(1) if 8 (q, a) = q, 

then introduce the transition 

q aq, 
(2)ifqeF 

ie, if q is the final state in FA, then introduce the production. 

qe 


Context Free Grammars 


PnosLEM 1 


Нат grammar to generate string consisting of any number of a's and write the 
паре generated by the grammar. 


a Transitions Grammar 
DFA - 6 (5, а) =5 4SaS 
Sis a final state 4$€ 
the grammar С = (V, T, P, 5) where 


V ={S} 
T ={a} 

5 =5 

P ={5-а5|є} 


he language generated by the grammar, L (G) = (a" | п 2 0) 


PnosLEM 2 


Main grammar to generate string consisting of atleast one a. 


— aD 


Transitions Grammar 
8(S,a)-A 25 -аА 
5 (А, =А дАЗад 
Aisa final state *Ao€ 
the grammar, G = (V, T, P, 5) 
where V={S,A} 
T={a} 
S=S 
Р={5->аА 
A2a4A|€) 


Obtain a grammar for the following DFA 


B . d 


Theory of С omputation 


— € 


Transitions Grammar ^ the grammar, С = (V, T, P, 5) 
6 (5, а) =А 5 -аА where V={S,A} 

5 (5,0) =5 25-55 T={a,b} 

5 (4, а) =А ^А-ад 5=5 

5(A,b)-A ^A-bA 


P={S>aA|bS 


Aisa final state .A— € 4a4A|bA|€) 


Рвовием 4 


Obtain grammar to generate strin, 


g consisting of any number of a's and b's wi 
atleast one a. 


— q 


Transitions Grammar + the grammar, G = (V, Т,Р, 5) 
6 (5, а) =А ^-5>аА where V={S,A} 

6 (5,5) =5 45555 T={a,b} 

6 (А, а) =А ^Аэад 5=5 

6 (А, Б) =А “A>bA P={S>aA|bS 

Aisa final state -. A > € A->aA|bA|e} 


Obtain a grammar for the following DFA 


— — a ——— 


Transitions Grammar 

5 (4,0) =А ^А-ЗОА 5 (В, 1] =В +B>1B 
ô(4,1)=B АА-1В 5 (С,0) =А «C204 
5(B,0)-C “B30C $(C,1)-B 26-18 


Cis the final state 


АС-Е 


Context Free Grammars 


à thegrammar, G= (V, T, ES) 
where У={А,В,С} 
Т={0,1} 
$=А 
P={A>0A|1B 
B>0C|1B 
C20A|1B|€) 


Рвовієм 6 


Мат а grammar to generate string consisting of any number of a's and b's. 


—— — q — — 


a, Transitions Grammar 
DFA E.G 5 ($, а) =$ 2$-а5 
6 (5,6) =5 25-965 


S is a final state 
5эЕ. 
The equivalent grammar С = (V, T, P, S) 
where V -(S) 
T ={a,b} 
$ =5 
P -(S—aS|bS|€) 
The language generated by this grammar, L (G) = { (a+b)"|n20} 


PRoBLEM 7 


Obtain grammar to generate string consisting of at least two a's. 


— — eum — — 


Transitions Grammar 
5 ($, а) =А 5 ->аА 
5 (А, а) = В д А-аВ 
6 (В, а) = В «BoaB 


Bisa final state “BOE. 


The equivalent grammar G = (V, T, P, S) 
where, V ={S,A,B } 


Theory of Computation 


T ={а} 
S ={5} 
P ={S>aA; АЗав 


ВәаВ|є} 


PnosLEM 8 


Obtain grammar to generate strin; 
atleast one a or atleast one b. 


— q 


Б consisting of any number of а’; and b's 


DFA 


Transitions Grammar 
6(S,a)-A ^$2aA 
6 (5,5) =А 25 ->ЬА 
6 (А, а) =А ^Аэад 
6 (А, Б) =А *A2bA 
Aisa final state >Аэє 


Тһе equivalent grammar G = (V, Т,Р, 5) 
where V = {5,4} 

T ={a,b} 

5 =S 

P ={5-аА|ЬА 
A—aB|bA|€) 


PRoBLEM 9 


Obtain grammar to accept the following language 
L={w|w|mod 3 >0, where wc {а}* } 


— a 


The minimum string that can be accepted is either a or aa. So the DFA is 


Transitions Grammar 
$ (5, а) =А ^$2aA 
(5) а а 
> » ô (А, a) = B +A>aB 
$ (B, a) = S “Boas 
Aisa final state “ASE 


Bis the final state “Boe 


The equivalent grammar, G = (V, T, P, S) 
were V ={S,A,B} 


T ={a} 

5$ =5 

Р ={5-аА 
А-аВ|Е 
В->а5|Е} 


o E 


Inthe previous problems context free grammars were formed for simple languages using 

finite automata. Here we are designing the CFG from the language directly, without using 

finite automata. The steps are as follows. 

Step 1: Understand the language specification by listing the examples of the strings in 
the language. 

Step 2: Determine the base case productions of CFG by listing the shortest strings in the 
language. 

Step 3: Identify the rules for combining smaller sentences into larger ones. 


Stp4: Testthe CFG obtained on a number of carefully chosen examples. All of the base 
cases should be tested, along with all of the alternative production. Also, check 
whether the grammar is consistent with the strings listed in Step 1. 


— — arm — — —— 


Obtain а CFG for the following language. L = а" b", n 2 0 


When n = 0, the production is 5 ^ € 

When n = 1, the string is ab, i.e., for every a one b has to be generated 
The production is 5 > a S b. 

The derivation for the string a b and aa bb is as shown below 


S 2aSb S 5aSb 
2a€b —»aaSbb 
эа b эааєЬЬ 
~aabb 


The CFG, Ge (V T, P, S) 
where V ={S} 

T ={a,b} 

$ =5 

P -(SoaSb|€) 


Theory of Computation 


PROBLEM 2 


Obtain а CFG for the following language, L = { а" b” | n 2 1 } 


— — «ИИ —— — 


When n = 1, the string is a b. 2 the production is 5 > a b 
When n is more than one, the string is aabb, aaabbb, ___ 
The production is 5 > a S b 
The derivation for the string ab and aaa bbb is as shown below 
Sab S 5aSb 
—aaSbb 
—aaabbb 
TheCFG, GE (V TPS) 
Where V ={S} 
T ={a,b} 
$ =5 
Р ={S—>aSb|ab} 


_ — — «m — — — 


Let X = (a, b), obtain a СЕС for the set of all palindromes over X. 


— —— lia ———— 


€ is palindrome 2 the production is $ — Є 
a|b is palindrome +. the production is S > a|b 
If w is palindrome then а w a and 2 е production is S > a S b | b S b 


b w b are palindromes 


Now with these productions we can generate the palindromes a b a or ababababa as shown 
below. 


5 эа5а S 2aSb 
эађа >abSba 
эађаЅађа 
~ababSbaba 


~ababababa 
~ababababa 


The CFG, GE (V T, PS) 


Where V ={S} 
T ={a,b} 
S=S 


P -(SoaSa|bSb|a|b|€) 


Obtain a CFG for the following language. L = { w w” | where w є (a, b}*} 


—— q ——— 


The strings that can be generated from this language аге €, aa, bb, abba, babbab, _ _ _ 
The productions are S ^ € 
S ~aSa|bSb 
The derivation for the string abba is as shown below 
S эаЅа 
~abSba 
эађєЬа 
эађђа 
The CFG, G = (V, T, P, S) 
Where V ={S} 
T -(a b) 
S =S 
P -(SoaSb|bSb|e) 


Obtain a СЕС for the following language L = ( w c w^ | where w € (a, b}*} 


The strings that can be generated from lis language are, c, aca, bcb, abcba, ____ 


+ the productions are 


S эс 

S 5aSa|bSb 
The CFG, G -(VLPS) 
where V ={S} 

T ={a,b,c} 

S=S 


P ={S>aSa|bSb|c} 


Theory of Computation 


Рповієм 6 
Obtain a CFG for the following language L = { м | n, (w) = п, (w) } 


— — q —— — 


Number of a's іп w should be equal to the number of b's in w. The strings that can} 
generated are, €, aa, bb, abab, bbbaabbb etc. 
For zero a's and b's, the the production is 5 > €. 
a can be followed by b the production is $ > a S b. 
b can be followed by a the production is $ > b S a. 
For the string abba the production is $ > SS 
the CFG, GE (V LP.) 
where V (S5) 
T ={a,b} 
5$ =5 
P -(SoSS|aSb|bSa|€) 


PRoBLEM 7 


Obtain a grammar to generate set of all strings with atleast one a, when X = { a, b) 


—— q — — 


The language contains one or more a's and any number of b's. The strings generated fron 
this grammar are 


а, ab, aaab, bab, ____ 
For any number of b's, the production is S > b S. 
For atleast one a from S, the production if S > a A. 
For a followed by any number of a's and b's, the productions are 


А->Е 

А-аА 

А-ЬА 

The grammar, G = ( Y T, P S) 

where у= {5, 4) 
T={ab} 
5=5 


P-(S—aA|bS 
A-aA|bA|€) 


Obtain a grammar to generate the language L = { a" b" | n20, m» n H 


—— SHIP — — 


п = 0, and т 2 1the string will be bb*. 

Ifn= Тапа m 2 2, the string will be abbb* 

Ifn=2 and m > 3, the string will be aabbbb* etc., 
2 The productions are 


S > AB 

А -Е [When n = 0] 

А 2aAb [When n = 1 two b's, n = 2 three b's etc.] 
B >b|bB 


s the grammar G = (И, T, P, S) 
where У -(SAB) 


T - (a,b) 

$=5 

Р ={$>АВ 
A2aAb|€ 
B>bB|b} 


Obtain a grammar to generate the language L = ( а" b"c|mz1andnz0) 


If m = 1 and n = 0 the string will be ab. 
т = 1 and п = 1 the string will be abc. 
ifm = 1 and n = 1 the string will be aabbcc. 
^ the productions are 
SAC 
A—ab|aAb [For every a equivalent b should be there] 
C»cC|e 
the grammar б = (И T, P, S) 


where V -(SAC) 


T ={a,b,c} 

5 =5 

P ={5-АС 
A>aAb|ab 
СэсС|є} 


Obtain а СЕС for the language of even palindrome, over the alphabet £ = (a,b) 


qC 


Strings of even palindromes are abba, aabbaa, baba abab, ____ 
The CFG, G = (V, T, P, S) 
where V ={S} 

T = (a,b) 

5 =5 

P -(S—aSa|bSb|€) 


Obtain a CFG for the set of all well formed parentheses. 


— ча ——— 


* €and ( ) are balanced -. the production is S > € 10 
* If wis balanced, then (w) is also balanced. х. the production is S > (S) 
* If wand х аге balanced, then wx is also balanced. 2. the production is S 5 5 
* The СЕС, G = (V, T, P, S) 
where V -(S 
Tst)) 
S =S 
P ={S$>SS|(S)|()1E€} 


Context Free Grammars 


Рвовієм 12 


CFG for the language L = (x є (0, 1)* | x Ваз unequal number of 0's and 15 } 


— qD 


MheCFG, G = (V, T P, S) 
Where V ={S,A,B} 
T ={0,1} 
S=S 
P ={S>A|B 
A—0|04|1A44]|A14A|AA1 
B51|1B|0BB|BOB|BBO) 


Obtain a grammar to generate the set of all strings with exactly one a, 


over E ={a, b} 


Thegrammar С = (V, T, P, 5) 
where V ={S,4} 
T -(ab) 
5 =5 
P -(SoaA|bS 
A2bA|€) 


Obtain a grammar to generate the set of all strings with atleast опе a over E = (a, b] 


— — qD 


Тһе ргаттаг С = (ИТ, Р, 5) 
where V ={S,A} 
T = (a,b) 
5 =5 
P ={S+aA|bS 
A2aA|bA|€) 


Obtain the CFG for the regular expression (a + b)* ab (a + b)* 


The given regular expression represents strings of a's and b's having a substring ab (a«b)' 
represents strings of a's and b's including NULL string. 


The CFG, G = (V, T, P, S) 
where V ={S,A} 


T ={ab} 
S=S 
P ={S>AabA 


A>aA|bA|e} 
Obtain the CFG for the regular expression (a + b)* ab 


The RE represents strings of a’s and b’s ending with ab. (a + b)* represents strings of a's and 
b's including NULL string 

"the grammar, G = (V, T, P. S) 

where V ={S,A} 


T ={a,b} 
5 =5 
P ={S—+AabA 


4A—aA|bA|€) 


Obtain the CFG for the Regular Ec Е (01)* 


The given RE is ofthe form AB, where А is 011 or 1 or NULL string and B is 01 or NULL string 
the CFG, G = (V T, P, S) 


where V= 
T ={0,1} 
S=S 
P ={S>AB 


А- 0114 |1А|Е 
В-018|Е} 


ntext Free Grammars | 


е sequence of substitutions used to obtain a string, is called derivation or parsing. It 
ieans replacing an instance of a given strings non-terminal, by the right hand side of the 
oduction, whose left hand side contains the non-terminal to be replaced. 


trexample consider the following productions, 
S xay 
«эВ 
йеп the replacement of a by В in x a y is called parsing or derivation. 
S эхау 
эхВу 


farsing produces a new string from a given string. Therefore derivation can be used 
mpeatedly to obtain a new string from a given string. If the string obtained after parsing 
«ntains only terminal symbols, then no further derivations are possible. 


There are two types of derivation 
i) Left most derivation, and 
ii) Right most derivation 


И И 


Aderivation А => w is called left most derivation if we apply a production only to the left most 
variable at every step. 


Consider the following production's 
5 >XYX 
X эа 
Yb 
The left most derivation for the string aba is as follows. 
$ ЭХҮХ 
-аух [:X2a] 
—abX [:Y25] 
aba [:X2a] 


A derivation A Š w is a right most derivation if we apply production to the rightmost variable al 
every step. 


Consider the following productions 
$ -ХУХ 
Х-а 
Y >b 
The right most derivation for the string aba is as follows. 
$ >XYX 
>XYa [:X24a] 
>Xba [:Y2b] 
aba [:X24a] 


ET ferreae] 
vau АЕ 


For the following production 
5>АВ 


A-aaAle 
BOBble 
write the left most and right most derivation for the string aab. 


Left most derivation for aab Right most derivation for aab 
S>AB S>AB 
2aaAB >АВЬ 
эаав 2Ab 
^aaBb 2aaAb 


>aab aab 


— arm 


find the left most and right most derivation for the string aaabba bbba, where G is 
($2aB|bA 
Aa|a$|bAA 
B5b|bS|aBB) 


— aeuum» —— 


left most derivation for aaabb abbba 


5 5aB 
~ aa BB 
aaa ВВВ 
— aaa bBB 
— ааа bbB 
— aaa bb aBB 
> ааа bba bB 
э aaa bb abbS 
~ aaa bba bbbA 
~ aaa bba abbba 


Right most derivation for aaa bba bbba 
5 5aB 


aa BB 

aa Ba BB 

aa Ba BbS 

aa Ba BbbA 
> aa Ba Bbba 
— aa Ba bbba 
> aaa BBa bbba 
— aaa Bba bbba 
— aaa bba bbba 


Write the left most and right most derivation for the string abbbb using the production. 


$-аАВ 
A>bBb 
В-А|Е 


— a 


Left most derivation for abbbb 


5 -аАВ 
>abBbB 
>abAbB 
>abbBbbB 
> a bb bb B 
> abb bb 


Right most derivation for abbbb 
S>aAB 

>aA 

>abBb 

~abAb 

2abbBbb 

э a bbbb 


| Theory of Computation 


The derivations or passing process in a context free grammar can be represented ий 
trees. Such trees are called passe tree/derivation tree. The vertices of parse tree are labela 
with terminals or non terminals. The root of the tree is the start variable, all internal nodd 
are labeled with variables and the leaves are labeled with terminals. The children of a noi 
are labeled from left to right with the right hand side of the production used. If an interij 
vertex is labeled A and the branches are labelled as x, x, | x then A > x, X, . x,m 
be a production in P. 


A derivation tree/parse tree for a СЕС, С = (V, T, P, S) is a tree satisfying the following conditions: 
(i) Every vertex has a label which is a variable or terminal or €. 
(ii) The label ofthe root is S. 
(iii) The label of an internal vertex is a variable. 


(iv) If a vertex has label A and x, x, ___ x, are children of A then A > X, X, 
production in P. 


;--.-X,must bei 


(v) If vertex n has label Е, then n isa leaf node and is the only son of its father. 


Let the CFG, G - (V, T, P, S) 
where V ={S,A} 


T ={a,b} 
P -(SOSS|aAS|a 
A>SbA|ba} 


The parse tree for the string aabaa is given as follows. 


A subtree of a parse tree is a particular vertex at the tree together with all the vertices and 
edges connecting them. It looks like a parse tree, except the root. The root may not be the 
start symbol of the grammar. 


Context Free Grammars 


JAsubtree of a parse tree, is a tree 


(i) whose root is some vertex v of T. 
| (ii) whose vertices are the descendants of v together with their labels and 
(1) whose edges are those connecting the descendants of V. 


Tor the parse tree of the previous example, the subtrees are 


PnosLEM 1 


for the grammar С - with production rules, 

E~E+E 

Bo EtE 

Eid 
where = {Е}, T = ( id }, 5 = ( Е), obtain the derivation and the parse tree for the 
string м = id * id * id 


Derivation for w: Parse tree for id + id * id 
E~E+E 
>Е+Е*Е 
>Е+Е*14 
эЕ+іа* іа 
іа * id * id 


Theory of Computation 


PRoBLEM 2 


For G=({S,B},{cd},P5S) 
where P={S>cBS|c 
BSdB|Ss|dc) 


Find the left most derivation and draw the parse tree. 


— a 


Left most Derivation Parse tree for ccdcddcc 
5 > сВ5 


 cSdBS 

> ccdBS 

> ccdSdBS 

э ccdcdBS 

— ccdcddcS 
э ccdcddcc 


Let G be a grammar with P given by: 
S —aB|bA 
A a |aS|bAA 
B >Ь| bS | авВ 


For the string w = aaabbabbba, find the left and right most derivations and also drav! 
the parse tree. 


left most derivation for w : 
$ -аВ 
>aaBB 
эаааввв 
—^aaabBB 
>aaabbSB 
>aaabbaBB 
—^aaabbabB 
—aaabbabbS 
—»aaabbabbbA 
~aaabbabbba 


hr G= ({Е, І), {a,b,c+*}, Е, Р} 
where Р = {ЕІ 

Е>Е+Е 

Е- ЕТЕ 

I a|b|c) 


— — q — — 


Parse tree for right most derivation of w. 


obtain two derivation trees fora + b*c 


Right most derivation for w : 


S—aB 
эааВв 
—aaBbS 
—>ааВЬБА 
—^aaBbba 
—aaaBBbba 
—aaaBbbba 
—aaabSbbba 
—aaabSbbba 
—aaabbAbbba 
—aaabbabbba 


— — dI» ——— 


First derivation tree for a + b * c Second derivation tree for a + b * c 


Derive the string 0111 00 from the following grammar, S > 0515 | 1505 | є ani 
draw the parse tree. 


—  — SEP —— — 


Derivation for 0111 00 parsetreefor011100 

590515 [ 
9015 
9011505 
9011150505 
901110505 
0111005 
2011100 


Derive the string abaaba from the following grammar, 
5 5aSa 


S >bSb 
S 5a|b|e 
and draw the parse tree. 


Derivation for abaaba 5 
$2aSa 
~abSba ET 
~abaSaba 


~abaaba | 


Parse tree forabaaba b $ b 


Context free grammars are the most commonly used kind of grammar in computer 
science. They provide a more powerful mechanism for language specification. Some of the 
applications of CFG are 


* Used in digital design 

* Used as basis for compiler design and implementation 

* Specifying syntax of programming languages 

* Representing syntactic structures in natural languages 


An ambiguous grammar is a context free grammar for which there exists a string that can have 
more than one leftmost derivation, while an unambiguous grammar is a context free grammar for 
which every valid string has a unique left most derivation. 

Let G = (V, T, P, S) be a context free grammar. A grammar С is ambiguous if and only if there exists at 


least one string w € T* for which two or more different parse tree exist by applying either the left 
most derivation or right most derivation. 


Show that the following grammar is ambiguous 
Е >Е+Е 
Е -Е-Е 
EE*E 


The string id + id * id can be obtained from left most derivation in two ways as shown below 
E~E+E E-E*E 
эіа+Е эЕ+Е*Е 
2id-E*E эіа+Е*Е 
id*id*E 2id*id*E 
> id * id * id id + id* id 
The corresponding parse trees for the two left most derivations are shown below. 


For the string id + id * id, by applying left most derivations we get two different parse trees 
^ the grammar is ambiguous. 


<= — — —— — 


Is the following grammar ambiguous? 
S 5а5|х XaX|a 


q 


Consider the two left most derivations for the string aaaa. 


S>as $—x 
aas эах 
эаааѕ 2aax 
эааах эааах 
эаааа эаааа 


The corresponding derivation trees for ће two leftmost derivations are shown below 


Since the two parse trees are different for the same string aaaa, the grammar is ambiguous. 


— earm - 


isthe following grammar ambiguous? 
S 5aB|bA 


A-aS|bAA\a 
B 5bS|aBB|b 


q —— — 


The string aabbab can be obtained from left most derivation in two ways. 


S>aB S—aB 
эаавВв —aaBB 
—aabSB >aabB 
>aabbAB —aabbS 
—aabbaB ~aabbaB 
—aabbab —aabbab 


The corresponding parse trees are shown below 


Since the two parse trees are different for the same string aabbab the grammar is 
ambiguous. 


Theory of C omputation 


PRosLEM 4 


Show that the following grammar is ambiguous. 
S>aSbs 


S >bSas 
5-5 


The string abab can be obtained from left most derivation in two ways as shown below, 


SoaSbS S>aSbs 
>abSaSbs —-aSbaSbS 
—^abaSbs эаһа$Ь$ 
эаһаһ$ ~ababs 
>abab >abab 


The corresponding parse tree for the two left most derivations are shown below. 


Since the two parse trees are different 


for the same string abab, the grammer is 
ambiguous. 


PnoBLEM 5 
Is the following grammar ambiguous? 
S »iCtS|iCtSeS|a 
C >b 


The string ibtibtaea can be obtained b: 


y applying left most derivation in different ways. The 
corresponding parse tree for the two | 


eft derivations are shown below, 


SoiCts SoiCtSeS 
2ibtsS 2ibtSeS 
2ibtiCtSeS 2ibtiCtSeS 
2ibtibtSeS 2ibtibtSeS 
2ibtibtaeS 2ibtibtaesS 


~ibtibtaea 2ibtibtaea 


Since two parse trees are different for the same string i b t i b t a e a, the grammar is 
ambiguous. 


Isthe following grammar ambiguous? 
5 -0515|1505|Е 


— — q 


Consider the two left most derivation for the string 0 1 0 1 


590515 590515 
90150515 9015 
9010515 9010515 
901015 901015 
20101 20101 


The corresponding parse tree for the two left most derivations are shown below 


Since the two parse trees are different the given grammar is ambiguous. 


Obtain the unambiguous grammar for the grammar shown 
Е -Е+Е|Е-Е 
E 9E*E|E|E 
E 5 (E)|I 
I 25a|b|c 


— — SHEEP —— 


The grammar can be converted into unambiguous grammar based on the precedence, 
The identifiers a, b and c have the highest precedence, then the expression within "(" апі 
and then * and/which ever occurs first from left to right and finally * or - whichever occur 
first from left to right. 
By assuming all these Operators are left associative, 

Гәа|Ь|с 

Е-(Е) |1 

T 9T*F|T/F|F 

E 9E«T|E-T|T 
50 the final grammar which is unambiguous is shown below. 

E 9E«T|E-T|T 

T 5T*F|T/F|F 

Е 5(E)|1 

I 25a|b|c 

Prosiem 8 


Consider the following grammar 

R > R/R|RR|R* | (R) | a | b 

i) Construct left sentential form and right sentential form for the string 
(a/b)* abb 

ii) Isthefollowinggrammarambiguous, Ifsoconstructanequivalentunambiguous 


grammar. 


i) 
Left sentential form Right sentential form 
R>RR R>RR 
> R*R Rb 
> (R)*R >RRb 
> (R/ R)*R —Rbb 
> (a / R*R —RRbb 
^ (a / b)*R Rabb 
> (a / b)*R.R >R* abb 
> (a / b)*aR > (R)* abb 
> (a / b)*a RR > (R/R)*a b b 
> (a / b)*abR > (R/b)* a b b 
> (а / b)*a bb > (a/b)* a b b 


ii) Checking ambiguity 
The sentence (a/b)* abb can be obtained from left most derivation in two ways as 
shown below 


КУЭ К.К К Е.К 
—R*.R —R*.R 
> (R)*.R > (R)*.R 
> (R/R)* .R - (R/R)* .R 
 (a/R)*.R > (a/R)* .R 
> (a/b)* .R э (a/b)* .R 
> (a/b)* R.R — (a/b)* ВВ 
ә (a/b)* aR ә (a/b)* К.К.К 
ә (a/b)* aR.R — (a/b)*aRR 
— (a/b)* ab.R — (a/b)* a b R 
 (a/b)* abb ә (a/b)*abb 


The corresponding parse trees are shown below. 


Since there exists two different parse tree for the sentence (a/b)* abb the given grammar is 
ambiguous. 


The unambiguous grammar is given below, 
I>a\b 
F>1I|R* 
T>F | (R) 
R>T|RT|R/T 
Itcan be rewritten as 
R>R/T|RT|T 
T—F|(R) 
F-I|R* 
I>a|b 


Theory of Computation 


Prosiem 9 


Check whether the following grammar is ambiguous. 
5 2AB|C 
A 25aAb|ab 
B 5cBd|cd 
С 5aCd|aDd 
D 5bDc|bc 


— — Фи — — 


Consider the string aabbccdd. 
This string can be derived using two different left most derivations as shown below. 


SoAB SoC 

2aAbB эаса 
>aabbB >aaDdd 
>aabbcBd >aabDcdd 
>aabbccdd >aabbccdd 


The corresponding parse trees are 


MING 


A B 
JN 
aAb c Bd 
E O 
b a c d 


Since it has two different derivations the grammar is ambiguous. 
Just as the regular sets have an equivalent automation - the Finite automata, the context free 
languages/grammars has their machine counterpart - the pushdown automation. 

A DFA (or NFA) is not powerful enough to recognize many context-free languages, since the 


finite automation have strict finite memories. The automation to recognize the CFL may 
require additional amount of storage. 


ADFA (or NFA) has limitations that they can not count and can not store the input for future 
reference, so we need a new machine called Push down Automation (PDA) to recognise CFL. 


PDA is a finite automata with the addition of a stack. A PDA has three components 
* an input tape 
* acontrol unit 
* astack with infinite size 


Input Tape 


Push 1 
bo. Finite ] 
control |- Accept/Reject 


unit 


APush Down Automata (PDA) is a seven tuple 
М= (0, Г, 8, qy Zy F) 

Where 
Q - is a set of finite states 
X - set of input alphabets 
T - set of stack alphabets 
8 - transitions from Q X (£ U €) XT to finite sub set of ОХ Г* 
q, € Qis the start state of M 

tial symbol on the stock 

Ес Qis set of final states. 


The transition function accepts three parameters namely a state, an input symbol and stack 
symbol and returns a new state after changing the top of the stack. The transition function 


has the form. 
8 (state, input symbol, stack symbol) = (next state, stack symbol) 


Example 1: 
| The transition 5 (P, а, Z) = (q, aZ) means that the PDA is in current state P and after scanning the 
input symbol a and with Z on top of the stack, the PDA enters into new state q pushing a on to the 
| stack. 


Example 2: 


The transition 8 (P, a, Z) - (а, 
on top of the stack, the machin 
Example 3: 


The transition 8 (P, a, Z) = (а, 
the top of the stack is Z, the i 


€) means that in state P, on scanning the input symbol a, when Zi 
е enters into state q and topmost symbol Z is poped from the stack 


Example 4: 


The transition 6 (P, €, b) = (P, €) means that in state P, without on input symbol and with b on top 
of stack the machine remains in same state, and deletes (pop) the topmost stack symbol b. 


* PDA is represented graphically using the following notations. 
* The states of the PDA is represented using circles. 


* The start state of the PDA is represented by a circle with an arrow not originating 
from any node. 


Final states are represented using two concentric circles. 


* Transitions are represented by labeled arc. If the transition is 5 (Р, a, Z) = (9, «) 
the arc from state Pto q will be labeled as a, Z/ a 


The graphical representation of 8 (Р, a, 2) = (9, az) is shown as 


LO (a, z)/az © 


The graphical representation of 8 (Р, a, 7) = (q, €) can be 


Ф) (а, 2)/є | @ 


The current configuration of PDA at any given instant can be described by an instantaneous 


description (ID). ID gives the current state of the PDA, the remaining string to be processed, 
and the entire contents of the stack. 


М = (0,5, T,6,q, 
(4, w, а) 

where 4-15 the current state 

w - the remaining string to be processed. 
& - is the current contents of the stack 


Zy F) be a PDA. An ID is defined as triplet. 


Context Free Grammars 


ample 
‘let ID of a PDA be (q, aw, Za) 
itmeans that 
q - is the current state 
aw - is the string to be processed 
| Za - current contents of the stack with Z on top of the stack. 
|f there was a transition like & (q, а, 2) = (р, B) then the new configuration obtained is 
(ри, Ba). It is represented as (q, aw, za) + (р, w, Ba). 
le, (q, aw, za) derives (p, w, Ba) in one move. 
| order to represent more than one move, we use H (ie.) (aw, za) H (p, w, Ва) 


There are two cases where їп a string w is accepted by a PDA. They are 


* Final state acceptance and 
* Empty stack acceptance 


1. Final state acceptance: 
Get the final state from the start state. 


In final state acceptance, the language accepted is the set of all inputs for which some 
choice of moves causes the push down automata to enter a final state. 


Get the final state from the start state 
Let M = (Q, E, Г, 8, qy Zy F) bea PDA. The language (М) accepted by final state is defined as 
ЦМ) = {w | (qy W. Z,) H* (P, €, а)} where a e T*, PE F we E* 
It means, the PDA currently in state q,, by processing the string w enters into a final state 
P and the contents of the stack is irrelevant. 
2. Empty stack acceptance 
Get an empty stack from start state. 
In empty stack acceptance, the language accepted is the set of all imputs for which some 
sequence of moves causes the push down automata to empty its stack. 
The language N(M) accepted by empty stack is defined as 
ММ) = {w | (qy W, Z;) -* (P, €, €)) where w Е Z*,q, PE Q 
It means that when the string w is accepted by empty stack the final state is irrelevant, the 
input string should be completely processed and stack should be empty. 


Theory of Computation 


Obtain a PDA to accept the language 
L(M) ={wew*| we (a + b)* ) where w” is the reverse of w. 


— — Фа» —— — 


Given that L(M) = {wc w^) 

if w = abb then reverse of w is denoted by w* will be w^ = bba. 
The Language L will be мси". (і.е.,) abb c bba. 

Which is a string of palindrome. So we have to construct a PDA which accepts a palindrome 
consisting of a's and b's with the symbol c in middle. 


— ши 


Push all the scanned symbols on to the stack till we find a symbol c. Once we pass the middle 
string, if the string is palindrome for each input symbol, there should be a corresponding 
symbol in the stack, pop it. Finally if there is no input and stack is empty, the given stringis 
а palindrome. 
Input symbol X = (a, b, с). The first input symbols can be а, b or c. 
Let q, be the initial state and Z, the initial symbol on the stack. 
Step 1: For input symbol a or b 
In state q, with z, on top of the stack, push the input symbols into the stack and 
remain in q,. 
54,4%) = (yz) 
5,1%) = (y bz) 
Once the first input symbol is pushed on to the stack, the top ofthe stack may be either 
a or b. Push all the symbols on to the stack and remain in state q, till we encounter c. 
The transitions for this can be 
ô (ayaa) = (qy a a) 
8(q,a,b) = (qy ab) 
8(q, b,a) = (qy ba) 
8(q, b,b) = (qy bb) 
Step 2: For input symbol c 
In state q, if the input symbol is c, the top of the stack may be either a or b or z, (z, 
when w is a null string), move on to new state q, and do not change the contents of 
the stack. The transitions are 
5 (4, са) = (q,a) 
6 (dy c, b) = (q,, b) 
5 (dy 6%) = (4,2) 


In the state q,, if the next input symbol is same as the symbol on the top of the stack, 
delete (pop) the symbol from the top of the stack without changing the state q, and 
repeat the process. 


3: For input symbols a or b (w*) 


The transitions are 
5(д„а,а) = (q, €) 
5(q, b,b) = (9,6) 

p 4: No more input symbols 


If there is no more input symbols and if the contents of the stack is 20 (i.e., empty), 
change the state to q2 which is the final state. The transition is 


ô (qy €) = (4,2, 
p5 
* The PDA M which accepts the language wcw” is given by 
М = (0,Х,Г,5,4,2, F) 


Where, 6: is shown below 
Q ={4,9,,9,} б (do az) = (Gy az) 
Reta Ке) 8 (90,20) = (Qy b z) 
T -(a bz) б (аа) = (q, aa) 
4, = {9} ô (dy b, a) = (qy ba) 
Z (zn) 5 (q a, b) = (q, ab) 
Е ={q,} 6 (do b, b) = (qy bb) 


5 (dy 6 Zo) = (Gy 25) 
6 (qy c, a) = (q, a) 
б (dy c, b) = (q, b) 
6 (q, a, a) = (q, €) 
б (q, b, b) = (q, €) 
ô Gy 6,2) - (qy 2) 


C, Zo/ Zo 
c, а/а 
c, b/b 


To accept the string 


The sequence of moves made by the PDA to check whether the string aabcha 
accepted or not. 


Initial ID 
(dy aabcbaa, 2,) 


| (qy abcbaa, a z,) 
F- (qy abcbaa, aa z,) 
| (qy cbaa, baa z,) 
| (q, baa, baa z,) 

+ (q,, aa, aa z,) 

| (q,,a,az,) 

[ы (9, є, 20) 

к (9, Е, 20) 


Since q, is the final state, and input string is € in the final configuration the stri 
aaabcbaa is accepted by PDA. 


To reject the string 


The sequence of moves made by PDA for the string aab C bab is shown below 


Initial ID 
(9, aabcbaa, 2,) 


+ (qy abcbab, a z,) 
| (q, bcbab, аа z,) 
| (qy cbab, baa z,) 
| (q,, bab, baa z,) 
| (q, ab, aa z,) 

| (q, b, az) 


since the transition 6 (q, b, a) is not defined, the string aabcbab is not a Palindrome, 
^ The string is rejected by the PDA. 


Context Free Grammars 


Рповієм 2 


instruct a PDA to accept the language L = (a" b" | n >, 1) by final state. 


— — q — — 


йеп that L (M) = (a^ b" | n >, 1) the machine should accept n number of a's followed by n 
ber of b's. 


Hush all a's into the stack. Once we encounter b's, there should be a corresponding a's on 
lestack. When the input pointer reaches the end of the string, the stack should be empty. If 
lack is empty, it indicates that the string scanned has n number of a's followed by n number 


Input Symbol X - (a, b) 
Let q, be the initial state and z, be the initial symbol on the stack. 
In the state q,, if the input symbol is a, irrespective of the content of the stack. Push a 
on to the stack. The transitions are, 

ô (dy a2, = (qy a Zg) 

ô (0а, а) = (qp aa) 
tep 2 
In the state q, if the next input symbol is b and if the top of the stack is a, then change 
the state to q, and delete one a from the stack. 

б (9, b.a) = (q, €) 
Step 3 

In state q, the rest of the symbols to be scanned will be only b's and for each 


b there should be corresponding a on the stack. If so remain in q1 and delete the 
corresponding a from the stack. 


The transitions are, 8 (q, b, a) = (q, €) 
Step 4 

In the state q, if the next input symbol to be scanned is € and if the top of the stack 

is z, change the state to q, which is an accepting state. The transitions are 

5 Gy, 6,2) = 4%) 
Step 5 
The PDA M which accepts the language (a" b^ / n» 1} 
М = (Q, ET, 8, q, Zy F) 


Where, 6: is shown below 


Q ={9,9,9,) $ (ay a, Z,) = (qy az,) 
Y ={a,b} 5(q,a,a) = (q, aa) 
Г ={a,z,} ô (qy b,a) = (4,6) 

4 ={9,} 5 (4, b,a) -(q, €) 

Z ={%} 6(4,,6,2,) =(9,2,) 

F ={9,} 


To accept the string 


The sequence of moves made by the PDA to check whether the string aaabbb 
accepted or not. 


Initial ID 
(qy aaabbb, z,) _+ (qy aabbb, а z,) 
+ (qy abbb, aa z,) 
+ (q,, bbb, aaa 2) 
+ (q, bb, aa z,) 
| (q, b, a z,) 
| (q, €, z;) 
F (q, € z)) 
(Final configuration) 


Since q, is the final state and the input string is € in the final configuration the strin 
aaabbb is accepted by PDA. 


To reject the string 
The sequence of moves made by PDA for the string aabbb is shown below. 
Initial ID 
(dy aabbb,z,) + (а, abbb, a z,) 
+ (q bbb, aa z,) 


Context Free Grammars 


| (q,, bb, az;) 
+ (da: b z,) 
(Final configuration) 

Since the transition 6 (q, b, z,) is not defined, the string aabbb is rejected by the PDA. 


Obtain a PDA to accept the language L = ( а" Б?" | n > 1 } using final state acceptance. 


— — q —— — 


Given that L = { a" b^^ | п 2 1 }, the machine should accept n number of a's followed by 2n 
number of b's. 


f General Procedure 
for each а in the input, push two a's on to the stack. Once we encounter b's, there should 
bea corresponding a's on the stack. When the input pointer reaches the end of the string, 


the stack should be empty. If the stack is empty, it indicates that the string scanned has n 
number of a's followed by 2n number of b's. 


Step 1 
Input symbol X = (a, b) 
Let q, be the initial state and 20 be the initial symbol on the stack. 


In the state q, if the input symbol is a, irrespective of the content of the stack, push 
two a's on to the stack. 


The transitions are 


8 (qy a, z,) = (qy aa z,) 
5 (а, а,а) = (qy aaa) 


Step2 
In the state q, if the next input symbol is b and И the top ofthe stack is a, then chan 
the state to q,, and delete one a from the stack. 

ô (qy b,a) = (q, €) 

Step 3 
In state q, the rest of the symbols to be scanned will be only b's, and for each} 
there should be corresponding a top of the stack. If so remain іп q, and delete the 
corresponding a from the stack. 

The transitions аге ô (q, b, a) = (q, € ) 

Step 5 
In the state q, if the next input symbol to be scanned is € and if the top of the stadi 
is z,, change the state to q, which is an accepting state. 

The transitions are 6 (q, €, z,) = (q, z,) 
Step 6 
*. The PDA, M which accepts the language { a" b?" |п>1} 
M = (Q, ET, 8, qy Zy F) 


Where, 6: is shown below 
Q ={4,9,,9,} 5 (y 4, Z) = (qy ааг.) 
Х ={a,b} б (qy a, a) = (q,, aaa) 
Г ={a,z,} б (9, b,a) = (4, €) 
4, ={9,} 5(q,b,a) -(q, €) 
Z ={2,} $(q,€ 2) = (9,2) 
Е -(q,) 

а, Z,/aaZ, n" 


а, 


Construct a PDA to accept equal number of a’s and Ь'$. 


(i.e) L = {w | w € (a + b)* and по, (и) = no,(w)) 


The language accepted by the machine should consists of strings of a's and b's of any length. 
Only restriction is number of a's in the string w should be equal to number of b's, but the 
order is irrelevant. 


first scanned input symbol is pushed on to the stack. If the next scanned input symbol is 
‘ame as on the top of the stack, push the current symbol on to the stack, otherwise pop one 
gmbol from the stack and repeat the process. When end of string is encountered if the stack 
empty, the string has equal number of a's and b's. 
‘Step 1 
Input symbol £ = { a, b ) 
Let q, be the initial state and z0 be the initial stack symbol. 
In state q, with z, on the top of the stack, push the input symbol on to the stack. The 
transitions are 
8(q, 0,2) = Gy 2%) 
8(qy b, Zo) = (qo b Zo) 
Step 2 
If input symbol is same as the symbol on top of the stack, push the current input 
symbol to the stack and remain in q0 only, else pop the top element from the stack 
The transitions are, 
6 (qy a, a) = (qy aa) 
8 (qy b, b) = (9, bb) 
5 (qy a,b) = (qy €) 
5 (qy b, a) = (qy €) 
Step 3 
If the next input symbol is € and top of the stack is z, then move to a new accepting 
state q, the transition can be of the form, 
5 (Ч, € 2) = Gy Zo) 
Step 4 
2 The PDA M which accepts the language L (M) = {w | w € (а + b)* and n, (и) = n, (м) ) 
is given by M = (Q, E, Г, 8, qy Zy Е) 


Where, 5: is shown below 
Q 7(2,4,) 5 Gy 42) = (qoy a Zo) 
X = (4,0) B(q biz) = (qs bz) 
Г ={a,b,z,} 5 (да,а) = (qy аа) 
в -(4,) 5 (qu b, b) = (9, bb) 
2-08) ô (qy a b) = (9, €) 
Е ={q,} 5 (qy b, a) = (9, €) 


ô (qy € z)) = Gy Zo 


Theory of Computation 


PRosLEM 5 


Construct a PDA to accept a string of balanced parentheses. The parantheses tob 
considered are (, ), [, ] 


— q ——— — 


Some of valid strings аге [ C) (O (11) 1,6, E1CED) 


Push each left parentheses on to the stack, if we find right parentheses which matches with 
top element of the stack. Pop top of the stack. When the input pointer reaches the end of the 
string, the stack should be empty. 


Step1 
Input symbol = (6), [,] } 
Let q, be the initial state and z, be the initial symbol on the stack. 
In the state q, if the first scanned parenthesis is ‘(‘ or '' push the scanned symbol on 
to the stack, and change the state to q,. The transition defined for this can be of the 
form, 
5 (9, 62) = (a. (2) 
5 (9, L2) = (9, 1%) 
Step 2 
If the scanned input symbol is left parentheses like ( or [ push it on to the stack. The 
transitions are 


5(q, CO = (4, CO 

ôa LD =(4„[[) 

5(a,GD = (CD 

6 (9,1,0) = (9,0 
Step3 


If the scanned symbol is right parenthesis like ) or | and if there is a matching left 
parenthesis on the top of the stack, pop the element from the stack. The transition 
can be defined as 


6 (4,1,0) = (a, €) 
6 (9,1,1) = (4, €) 
Step 4 


When top ofthe stack is z,, and there is по more input symbols, change (ће state to 4, 
which is the final state. The transition is 8 (q, €, z,) = (q Z) 


Step 5 
^ The PDA M which accept а string of balanced parentheses is given by 
М = (Q, ZT, 5,9,2, Е) 


Where, 6: is shown below 
Q = (4,4,4,) $ (9, (2,) = (9, (Zo) 
У =((),11) 6 (qy b 2) = (av [2,) 
Г ={ 062} б (9,0) =@, (0 
9 ={9,} Sa LD = (a, ED) 
Z ={2} б (4,0) = (CD 
Е ={q,} $(q,), 0) = (a, €) 


ё (4,1,0) = (4,9 
б (9,Є,2,) = (2,2) 


(350 Theory of Computation 


Prosiem 6 


Obtain a PDA to accept the language L (М) = { w w? | w € (a + b)* ) where и" is the 
reverse of w by final state acceptance. 


— — AGED — 


Given that L(M) = { ии" } 
if w = abb then reverse of w is denoted by и" will be w^ = bba. 
The language L will be ww* = abb bba. 


Push all the scanned symbols on to the stack, till we find mid point. Once we pass the middle 
string, for the reverse string for each input symbol, there should be a corresponding symbo 
on the stack. Finally if there is no input and stack is empty, the given string is ww*. 


Step 1 
Input symbol $ = (a, b } 
Let q, be the initial state and z, be the initial symbol on the stack. 
In the state q, with z, on the top of the stack, push the input symbols into the staci 
and remain іп q, 
5 (ayaz) = (4y az) 
5 (9, 6,2.) = (qe bz) 
Now in state q,, push the input symbols a or b to the stack, irrespective of the stac! 
symbols. The transition are 
5 Gy aa) = (qy aa) 
8 (ay a, b) = (qy ab) 
5 (qy b, a) = (qy ba) 
5 (qy b, b) = (qy bb) 
Step 2 
Once we reach the midpoint, if the next input symbol is same as the symbol on th 
top of stack, move to state q, 
$(q,a,a) = (q, €) 
8 (qb, b) - (а, €) 
Step 3 
In the state q, repeat step 2 until we find empty input. The transitions are 
5 (Ч, а,а) = (q, €) 
$(q, b b) = (q, €) 


Step 4 


Finally in state q, if the string is a palindrome, there is no input symbol to be scanned 
and the stack should be empty. Now change the state to q,. The transition for this can 


be, 
ô (qy €, 2%) = (qy Zo) 
Step 5 


2 The PDA, M to accept the language L (М) = ( ми” | w € (a + В)* } is given by 
М = (Q, , Г, 5, qy Zy F) 


Where 
Q = {ay 4,4;) 
X -(ab) 
Г ={a,b,z,} 
z ={%} 
F ={q,} 


6: is shown below 
5 (qy az) = Gy 2%) 
6 (qy b, z,) = (dy b Zo) 
8 (qy a, a) = (qy aa) 
8 Gy a, b) = (4, ab) 
5 (4, b, a) = (qy ba) 


а, Z/az, 
b, z,/bz, 
а, а/аа 
a, b/ab 
b, a/ba 
b, b/bb 


а,а/ є 
& b,b/€ © Е, Zo/ Zo © 


8 (q,, b, b) = (а, bb) 
5 (q a, a) = (q, €) 
5 (qo b, b) = (а, €) 
5 (q, a, а) = (9,6) 
5 (q, b, b) = (q, €) 
ô (4; €, Zo ) = (ax Zo) 


а,а/ є 
b,b/ € 


Let M = (Q, Х, Г, 5, qy Zy F) bea PDA. The PDA is deterministic if the following conditions are 


satisfied. 


1. 6 (q, a, z) has only one element 


2. If 6 (q, €, 2) is not empty, then ô (q, а, 2) should be empty. 


Theory of Computation 


Рповієм 1 
Is the PDA to accept the language L (M) = ( wc w^ | w € (a + b)* ) deterministic? 


The transitions defined for this machine are, (refer Problem 3.13.1) 


§ G42) = (q, az) 6 (Ч 6,2) = (9, 2) 
5(q, bz) = (q bz) 5 (qy c, a) = (q, a) 
$(q,a,a) = (qy aa) 5 (dy c, b) = (q, b) 
5 (y b, a) = (qy ba) 5 (q, a, a) = (q, €) 
5 (qy a, b) = (qy ab) ô (q, b, b) = (q,, €) 
б (q, b, b) = (а, bb) 5 (qy Е, 2) = (4„ 2, 


i) The first condition to be deterministic is б (д, а, 2) should have only one element. In 
this problem. For each q Е Q, a € and Z €T, there is only one element defined. 


ii) The second condition states that if 5 (9, €, 2) is not empty, (i.e.) 5 (q,, €, z,) is defined 
then there should not be any transition from the state q, when top of the stack is z, 
which is true. 


Since the PDA satisfies both the conditions, the PDA is deterministic. 


Is the PDA to accept the language L = (a" b" | n 2 1} deterministic? 


—_ qa 


The transitions defined for this machine are (refer Problem 3.13.2) 
6 (Ч а,2,) = (qy aZ) 
ô (qx a, a) = (9, aa) 
ё (qy b,a) = (q, €) 
8(q, b,a) = (q, €) 
$(q,€,2,) = (4, €) 


i) The first condition to be deterministic is 8 (q, a, z) should have only one element. In 
this problem, for each q Е Q, a € £ and Z ET there is only one element defined. 


ii) To satisfy the second condition, consider the transition 5 (Ч, €, z,) = (q, €) is defined, 
the transition б (q, а, z,) where a € X should not be defined which is true. 


Since the PDA satisfies both the conditions. The PDA is deterministic. 


Context Free Grammars 


PnosLEM 3 


the PDA to accept the language L = ( а" b^" | n > 1 ) deterministic? 


ФЕНИ» — — 


fhe transitions defined for this machine are (refer Problem 3.13.3) 
ô (dy à, z,) = (qy aaz;) 
ô (qy a, а) = (qy aaa) 
ô (qy һа) = (qp €) 
5(q, b,a) = (4,6) 
ô (qp €, X) *(q,€) 
foreach q € Q, a € © and Z ET there exists only one element so the first condition is satisfied. 
Since the transition 6 (q, X, z,) is defined, the transition 8 (q, 1, z,) where a € Х should not 
te defined which is true. 
Since both the conditions are satisfied, the PDA is deterministic. 


к ће PDA to accept the language L (M) = {w | м Є (a+b)* and по, (и) = по, (м) } is 


deterministic? 
— a 
The transitions defined for this machine are (refer example) 
5 (dy 4,2) = (qyaz;) 
5 (qy b, 20) = (Gy 5 Zo) 
5 (qy a, a) = (Ч, aa) 
5(4, b, b) = (qy bb) 
5 (Qy a b) = (q, €) 
5 (qy b.a) = (qy €) 
5 (9,6,2,) = (8.7, 
For each q € Q, a € £ and Z ET there exists only one element, so the first condition is satisfied. 
Since the 8 (4, E, z,) is defined, the transition 6 (q, a, z,) where a € E should not be defind. 
But there are two transitions. 
5 (qy 4,2.) = Gy 4%) 
5 (qy b, Zo) = (Qy b Zo) 
defined from q, when top of the stack is z, Since the second condition is not satisfied, the 
given PDA is non-deterministic PDA. 


Theory of Computation 


Prosiem 5 


Is the PDA to accept the language L = { w w? | w E (a + b)*) is deterministic ? 


— — q 


The transitions defined for this machine are, 

5 (dy, 4,2) = Ч,аз,) 

5 (dy 6,2) = (dy b %) 

5(q,a,a) = (9, аа), (q, €) 

(qy a, Б) = (qp ab) 

8(q, b,a) = (qy ba) 

5 (9, b, b) = (qy bb), (q, €) 

ô Gy €, 2) =(4„2,) 


For each q € Q, a € Z and Z Є Г there exists only one element. But there are two transitions 
having two elements 


ô (qy а, а) = (q, aa), (q, €) 
5 (dy b, b) = (qy bb), (а, €) 


So the first condition fails. To be deterministic, both the conditions should be satisfied. So 
the PDA is non-deterministic PDA. 


1. Formally define a grammar 
2. Explain passing 
3. Define left most derivation with an example 
4. Define right most derivation with an example 
5. Write the application of CFG 
6. Show that the following grammar is ambiguous. 
S 5aSbsS 
5 bSaS 
5 -Е 
7. Obtain the grammar to generate the language L = { а" Б" с" |т>1,п>0} 


8. Define deterministic PDA. 


1 Explain chomsky hiesarchy of generative grammars. 


2. Define CFG and the language accepted by a CFG. 
3. Define parse tree and subtree with examples. 
4. Define PDA, language acceptance of PDA and ID. 
5, Explain with an example ambiguous and unambiguous grammar. 
6. For the grammar G - (V, T, P, S) 
Where V {$}, Т = (a.b) and P= (52 aSa|bSb|€) 
Construct a leftmost, right most and parse tree. 
3) aaaaaa 
b) abbbba 
с) bababbabab 
‚ Design a PDA to accept the following language over X = (0, 1} 
L = {0",1"|n21} 


eee 


410 Conversion of CFG to PDA 


CFG, it is not necessary to use all the symbols in V or all the productions in P, for deriving 
ces. So we can reduce the complexity of the grammar, without reducing the generative 
rof CFG. This is done by simplifying CFG, where in we eliminate useless symbols, 
productions and unit productions. Normal forms is one way of describing of grammar. In 
chapter we explore two types of normal forms - CNF and GNF. 


substitution method a non-terminal is replaced by the corresponding symbols on the 
t-hand side. 


let G= (V, T, P, S) bea context free grammar. Consider the productions. 


А 2x Bx, 

Byz» 
The production A > x, B x, can be replaced by A — x, y, x, | x, y; x, |----х,У, x, and the production 
lay, ly, |----y, in P can be deleted. 


The resulting productions are added to P, and the variables are added to V,. The language generated 
ty the resulting grammar С, = (V, T, P, 5) is same as the language accepted by б. i.e., L (G,) =L (G) 


— — arm 


Consider the production A > aBa, В > ab|b simplify the grammar by substitution 


/— — —««mm» — 


Inthe production, A > a Ва 


Bcan be replaced by the production B > ab|b as shown below 
A —aaba|aba 
^. The resulting grammar, G = (V, T, P, S) 


Where V = {A} 
T - (a,b) 
S =A 


Р = (A > aaba|aba) 


A grammar G is said to be left recursive if there is some non-terminal A such that 


А= Ао. fora € (VU T)* 
i.e, if the first symbol on the right hand side is а non-terminal same as left hand side and if! 
derivation is obtained from the same non-terminal, we say that the grammar is left recursive. | 


Left recursion should be eliminated from the grammar, because if it is there the grammar will e 
into an infinite loop. 


4.2.1 


Left recursion in a grammar G can be eliminated as follows. Consider the A-production 
the form, 


А Аа | Аа, | Aa, ____ |Aa,| B, | B,____| B, 
Where B's do not start with A. Then the A-productions can be replaced by 
A 2B,A|B,4 | B,A |... | B,A' 


A >a, A'la, A'la, A'l- la, Ale 


Eliminate left recursion from the following grammar. 


E ЭЕ+Т|Т 
T 5T*F|F 
Е (Е) | id 
q —— — 
Consider the production E> ETIT, 
« В 
it can be replaced by 
Е ЭТЕ 
E ++ТЕ|Е 


Consider the production T ^ T * F | Е 
it can be replaced by 
T КЕЧ 
T 2*FT'|e 


Consider the production Е (E) id. It is not left recursive 
2. The grammar obtained after eliminating left recursion is 


ESTE Е +ТЕ|є 
TFT Т-+*ЕТ'|Е 
Е > (Eid 


Illininate left recursion from the following grammar E> E+E|E-E|E*E|E/E |id 


— — qa —— — 


ТЕЕ [ЕФЕ E+E] E/E] id 
а [4 ^ ой 
un be replaced by 
E 5idE 
Е э +ЕЕ |-ЕЕ |*EE |/EE |€ 


lininate left recursion from the following grammar 
S 5Ab|a 
A — Ab | Sa 


—— q — —— 


he non terminal S is not having immediate left recursion, but if we substitute for S in A 
roduction, it becomes left recursive. 


е, А > Ab | Sa can be written as A > Ab | Aba | аа 

y substituting 5 using 5 > АБа. 

ow A production is left recursive and can be eliminated as below 
А эаад 
A' > bA' | baA'| Е 

^. The grammar obtained after eliminating left recursion is 

S 2Ab|a 
А эаад 
A эЪА'|Бад'|є. 


Normal Forms for CFG 


In a CFG, it may not be necessary to use all the symbols or all the derivations for de 
sentences. So we simplify the grammar by eliminating those symbols and production 
are not useful for the derivation of sentences, without reducing the generative powe 
context free grammar. Simplification of CFG is done by 


* Eliminating useless symbols. 
* Eliminating unit productions and 
* Eliminating € - productions. 


Any symbol is useful when it appears on the right hand side, in the production rule 
generates some terminal string. If no such derivation exists then it is supposed to be 
useless symbol. 

Useless symbols are those variables or terminals that do not appear in the derivation d 
terminal string from the start symbol. 


In a CFG, G = (V, T, P, 5), X is useless, if it does not satisfy either of the following conditions. 
(a) X5 w, where wis in T* or (b) SSaxBSwinL(c) 


Consider the following grammar, 


G =(ИТР 5) 

У ={А, В, 5, Е, F} 
T = (а,Ь, c, d) 

5 =5 

Р ={5- АВ, 

А >a 

B >b 

E >c 

F >d} 


In this grammar, the variables Е and F are useless because they cannot be reached from 5, 
Terminals c and d are useless because they are not reachable from S. 
Productions Е > c and F > d are useless because they cannot be reached from 5. 


Even if we remove these unnecessary variables, terminals and productions the language accept- 
ed will be the same. 


7. After simplification the grammar, G' is as follows 
G' = (V, T', P', S) 
Where V-(ABS) TT-(ub  S-S 
P'-(S2AB А-а Bb) 


п convert a grammar to an equivalent one with no useless symbols by first applying 
mal and then Lemma2. 


ena CFG, G = (V, T, P, S) with L(G) = ф, we can find an equivalent СЕС, G' = (Т.Р. 
ħthat for each A in V there is some w in T* for which А 5 w. 


variable A with production A > w in P clearly belongs to V. If A > X, x, _--X,isa 
mduction, where each X, is either a terminal or a variable already placed i in V, then a 
inal string can be added to И. The set V can be computed by the following straight 
ard iterative algorithm. 


OLDV = ф; 
NEW V = {АЈА > w for some w in T*}; 
while OLDV + NEWV do 
begin 

OLDV = NEWV; 

NEWV = OLDV U {A|A > a for some a in (T U OLDV)*} 
end 

=NEWV 

end 


Given a CFG, G = (V, T, P. S) we can find an equivalent CFG, С = (V, T, P', S) such that for each 
Xin (V U Т) there exist a and В in (V U T')* for which SŠ axg 

Lemma 2 states that all the variables in V' and all the terminals in 7" should be reachable 
from S. Р' is the set of all productions whose symbols are in V О T. 

Now by applying lemma 2 on G, we can find G' as follows. 


Step 1: Расе Sin V 


Step 2: If A is placed in V and A > а 


110,1... Га, is a production then add all varia 
of a, а, а, to T". 


Step 3: P'isthe set of productions of P containing only symbols of (V' u Т} 


PnosLEM 1 


Eliminate the useless symbols in the grammar 
S ^aA|bB 
A >аА|а 
B >ЬВ 
D ~>ab|Ea 
С ^aC|d 


Step 1: By applying lemma 1, we can obtain a 


set of variables from which we get onl 
string of terminals as shown. 


$ ADE А-а 
Dab 

Ed 

ADE ADES $5aA 
А-адА 

р-Еа 

ADES | ADES m m 


The resulting productions will be 
5 >аА 
А >аА|а 
D  Ea|ab 
E >d 
Step 2: Applying lemma 2, we obtain the s 


ymbols such that each symbol X is reachable 
from the start symbol S, as shown bi 


elow 


$ >аА 
А-аА/а SA 


The resulting grammar, G' after eliminating useless symbols is G' = (V. 15. P$) 
Where V' - (S, A) 


T = {a} 

S-S 

P'-($2aA 
A2aA|a) 


Himinate the useless symbols in the following grammar. 
S AB 
Aa 
B >b|C 
E >d 


— — q ——— 


Step 1: Apply lemma 1 


The resulting productions are 


S ЗАВ 
A >a 
_ B >b 
ABE|ABES| S>AB Ed 
A, B, E, S | A, B, E, S _- 
Step 2: Apply lemma 2 
- В 5 
SAAB - SAB 
А-а а SAB 
Bb a,b SAB 
The resulting grammar G' = (У, T', P', S) 
T' = (a, b) 5=5 
А-а Bb) 


Eliminate useless symbols in the grammar 
S — АВ | СА 
Aa 
B >ВС| АВ 
C 5aB|b 


Step 1: Apply lemma 1 


ф AC А-а 


Cb 
AC А, С,5 SCA 
ACS ACS 3 


The resulting productions are 
SCA 
Cb 
Ava 
Step 2: Apply lemma 2 


SCA | SCA | 
Cb b SCA 
А-а | ba | sca 


The resulting grammar G' = (V, Т, Р, S) 
Where V ={S,C,A}  T'-(ba) 5=5 
Р' ={S>CA_ Cob Aa) 


Eliminate useless symbols from 
$ 5AB|a 
Aa 


— qa 


Step 1: Apply lemma 1 


SA SA 
The resulting productions are 


5 эа 


А эа 


2: Apply lemma 2 


The resulting grammar С = (V, Т, Р,$) 
Where V ={5} Т={} 5=5 P'={S> a} 


inate useless symbols from the following productions 
5 —^aAa 
А Sb 
A ^ bCC 
А > рад 
С > abb 
€ ^ DD 
E ^ aC 
D „ара 


[^ C> abb 


o 
C CAE АЗЬСС 
E>aC | 
CAE CA, E, S S>aAa | 
CAES | CAES A>Sb 
CAES | CA, E, S 


The resulting productions are 
S > aAa 
A >Sb|bCC 
C — abb 
E 5 aC 


Step 2: Apply lemma 2 
Eee Са и түүр 2ш 
2 z s 
5 > aAa а SA 
А-5Ь ab SA 
А- bCC a,b SAC 
C> abb ab SAC 
^ The resulting grammar G' = (И, T, P", S) 
Where И" = (S A, С} 
T' = (a, b) 
5=5 
Р' ={S>aAa 
А sb | bCC Cabb) 


Eliminate useless symbols from 
5 ^aA|a|Bb|cC 
A >aB 
В >a|Aa 
C >cCD 
D > ааа 


— ча» —— 


Step 1: Apply lemma 1 


o SBD 5-а 


Boa 

D > ааа 
S, B, D S, B, D, A S> Bb 

A>aB 
S, B, D, A S, B, D, A S>aA 

B > Аа 
S, B, D, А 5, В, D,A B 


The resulting productions are 
S эад | ВЬ |а 
А >аВ 
В >Аа|а 
р >ааа 


B 5 


5 ад а SA 
S Bb a,b SAB 
Sa ab SAB 
А>аВ ab SAB 
B> Аа a,b $, А, В 
Boa 


The resulting grammar С' = (V, T,P,S) 
Where V' = {5, А, B) Т' = (a, b) 5=5 
P' ={5 > aA | Bb |а Аав B > Аа | a} 


PRoBLEM 7 


lliminate the useless symbol from the following grammar 
5 >aS|A|C 
Aa 
B ^aa 
D ась 


————SEHEP — 


йер 1: Apply lemma 1 


o Aa 
В > аа 
AB ABS 5>А 
ABS ABS S> aS 
The resulting productions are 
S +A\aS 
А эа 
B >аа 


Step 2: Apply lemma 2 


meum rm m 


$24 - SA 

SaS a SA 

Ауа а SA 
The resulting grammar G=(V',T',P',S) 
Where У" = (S, A} T'= (a) 5=5 


Р'={$эА|а$ А-а} 


Normal Forms for CFG 


РвовьЕм 8 


From the following grammar eliminate useless symbols. 
S -А11В |114 
$ -АВ|11 
A20 
В э ВВ 


—_ q — — 


Step 1: Apply lemma 1 


SA SA S>11A 

5, А SA - 
The resulting productions are 

$ 2114|11 

A 20 


Step 2: Apply lemma 2 


The resulting grammar G' = (V, T', P", S) 
Where И" = (S, A} 

T'-(1,0) S=S 

Р' ={S>11A] 11 A20) 


Eliminate the useless symbols from the following grammar. 
S —as|A|G 
Aa 
B ^aa 
C ^5 aG 


1: Apply lemma 


Го T NEW! x 
A,B А-а 


> 
is Вэ аа 
AB ABS 5->А 
| ABS | ABS EY 
ABS | ABS 
The resulting productions are 
S 2A|a$ 
Aa 
B aa 


Step 2: Apply lemma 2 


SA - SA 
Sas a SA 
А-а а SA 
The resulting grammar G' = (V', Т", P', S) 
Where V' = {5,4} T' = (a) S=S 
P' ={S>A|aS Aa) 


Eliminate the useless symbol from the following grammar 
5 —^XY 
5-0 
X21 


Step 1: Apply lemma 1 


The resulting productions are 
S20 
X21 


Step 2: Apply lemma 2 


[ec pap pom] 


S20 0 5 


The equivalent grammar G' = (V, T, P', S) 
V-(S) T'={0}  S-S P'={S>0} 


4.5.1 
Productions of the form A > € are called € - productions. € - productions are undesirable 
a context - free grammar, unless an empty string is derived from the start symbol. Supp 
the language generated from a grammar does not derive any empty string and the gram 
consists of € - productions, such € - productions can be removed. 


Let G = (V, T, P, 5) be a context - free grammar. A production in P of the form, A > € is called an € 
production or NULL production. 


4.5.2 


* | 
IfAisavariableand А — € [i.e.,ifAleads to an empty string in zero, one or more derivation}, 
then A is called Nulluable Variable. 


Let G = (И ТР S) bea context free grammar. A nullable variable is defined as follows. 

(i) IfA > € is a production in P, then A is a nullable variable. 

(ii) IfA > B, В, ___ B, isa production in P, and if B, B, _ __ B, are nullable variables, then Ais 
also a nullable variable. 

(iii) The variables for which there are productions of the form shown in step (i) and step (ii) are 
nullable variables. 


ider the grammar 
S — ABCa | bD 
A 2 BC|b 
Bb|e 
C 2c|€ 
D >d 
this grammar, the productions 
B >€ 
C.E 


є - productions and the variables B, 
both B and Care nullable variables, 
len though a grammar С has some Є ~ producti. 
ontaining empty string. In such cases, the € - pro 
ind they can be eliminated. 


Care nullable variables. Since there is a production. А ^ BC 
then A is also a nullable variable. 

ons, the language may not derive a language 
ductions or NULL productions are not needed 


(= (УТ, Р, 5) is а context free grammar, then there exists а context free grammar, G', having 
Е- productions such that L (6) = L (G) - {Е} 


eorem can be proved or the grammar G' can be obtained by applying step 1 and 


p 1: Construction of a set of nullable variables. 
The nullable variables, w can be computed recursively as follows: 
(i) м = {А | Aisin Vand A > € is in P) 
(ii) w,,=w,U{A | Ais in Vand A > a, for a іп wi) 
(iii) Repeat step (i) and step (ii) until w= м/ +1 
йер 2: Construction of P'. 

(i) Any production whose right hand side does not have any nullable variables 
is included in P'. 

(ii) For every production of the form. A > a in P [a € w,*] add to P' all the 
productions that can be obtained from this production by deleting any 
subset of occurances in a of nullable variables. 

Since the nullable variables are eliminated, it is clear that G' 
null productions. Hence proved. 


does not contain any 


PnosLEM 1 


Consider the following grammar G - (V, T, P, S) 
Where V = (S, А, B, D) 
T = (a, b) 
5=5 
Р= {5 - АВ |а 
Ae 
Bec 
D >b} 
Construct a grammar, G' without nullable productions equivalent to the abon 


grammar. 


Step 1: Construction of a set of nullable variables. 
А -Е 
Boe 
w, ={A, В} 
w, = (A, B) U (S) 
[Since in the production 5 > AB, the nullable variables, w, 


= {A, B, 5} occurs in the Right hand side] 
w, = {4, B, S}U b 
= {A, B, S} 
i.e., set of nullable variables 


w= (A, В, $} 
Step 2: Construction of P ' 
P'is obtained by deleting the subsets of nullable variables from the productions, 
Consider, D > b 
The right hand side of this production does not have any nullable variable 
Consider, $ > AB 
By deleting the subset of nullable variables it generates. 
S >B 
5 ЗА 
Consider S > a Sit generates 5 > а 


Theory of Computati 


‚ The equivalent grammar without Е - productions G = (V', T, Р’, S) 
Where V' = {S, А, В, D) 
T = (a, b) 
5$ =5 
P' = (S АВ|В|А|а 5|а 
Db) 


G = (V, T,P, S) 
re V ={5, А, B} 
Т = {а,Ь,с} 
Р = {5 > ВАА В 
А > адс | сАа | € 
В-АВ|ЬВ | €} 
struct G' without є - productions. 


— — q —— — 


p 1: Construction of a set of nullable variables 
w, = (4, B) Since A > € 
Boe 
w, = {А,В} {$} Since S ^ BAAB 
= (A, В, S) 
w, -(4,BS)UO 
= {A, В, 5} 
м = (А, В, S} 
йер 2: Construction of P' 
Consider 5 > ВАА В, 
by deleting one nullable variable it generates 
S 5AAB 
5 -ВАВ 
5 -ВАА 
by deleting two nullable variables 
S ЗАВ 


5 BA 
5 -ВВ 
S ЗАА 
by deleting three nullable variables. 
SB 
5 ЭА 
considerA—a4Ac  itgeneratesA— ac 


сопѕійегА э сАа  itgeneratesA— са 
consider В AB — itgenerates B5 В 
BoA 
consider B > b B it generates В > b 
The equivalent grammar without Е - productions is G' = (V', T, P', S) 
where V' = (S, A, B) 
T - (a, b) 
5$ =5 
P' = (S BAAB | ААВ | ВАВ | ВАА | АВ | ВА | ВВ | AA | B| A 
А ^ адс | ac | сда | са 
B > AB | B | A |bB | b} 


—— — о ЭУ ______—_ 3 


Consider the productions, 
5-АВ 
А-адА | є 
В-ЬВВ | є 
Find а СЕС, without є - productions. 


a 


Step 1: Construction of a set of nullable variables. 


w, = (AB) Since A> € 
Boe 
w, = {А,В} (S) Since S AB 
= {A, В, S} 


и, = {A, B, S} U Ø = {А, В, S) 


3 


w = (А, В, S} 


|Theory of Computation 


: Construction of P' 
consider 5 + АВ itgenerates$2 A, S > B 

consider A — aAA itgeneratesA ад, Aa 

consider В э b BB it generates В b B, B^ b 

. The equivalent grammar G' without € - productions. С' = (И, T, P, S) 
where V' = (S, А, B) 


Т - (a, b) 

5 =5 

Р' = (S2 AB|A|B 
A ^ aAA|aA|a 


B > bBB|bB|b) 


Prosiem 4 


iiia CFG, without € - productions equivalent to the following grammar. 
$2ABCa|bD 

ASBC|b 

Bob|e 

C2c|€ 

рэа 


— q — — 


Sep 1: Construction of a set of nullable variables. 


w, = {B,C} [Since B > €, C > €] 
w, ={B, C} U {A} Since A > BC] 
= (A, В, C) 
w, ={А, В, C}U Ø [S > ABC a cannot be considered since a is 
present in the = {A, B, C} right hand side] 
w ={A,B, C} 
йер 2: Construction of P' 
5>АВСа 
itgenerates S—+BCa 
S2ACa 
S>ABa 
5>Са 
5>Аа 
5>Ва 


5>а 


Consider $ b D [по null able variables in the В.Н.5.] 
Сопзїйег А — BC  itgeneratesA > В, АУС 
A-b [no null able variables in the R.H.S] 
B>b 
C>c 
D>d 
The equivalent grammar G'= (V', T, P', 5) 
where И" = (S, A, В, C, D) 
T - (a,b, c, d) 
5 =5 
Р' = {5 > ABCa | BCa | ACa | ABa | Ca | Ва | Aa | a | bD 
Аэ BC|B|C|b 
Bob 
Cc 
р-а} 


Eliminate є - productions from 
5 > BAAB 
А > 0A 2|240| € 
В -АВ|1В|є 


Ш 


Step 1: Construction of a set of null able variables. 
w, = (A4, B) [Since A > e, B5 є] 
м, = (А, B) U (S) [Since 5 > BAAB] 
= (A В, 5} 
w, ={А, В, $} 00 
= (4, В, S) 
a w = {А, В, S} 
Step 2: Construction of P 
consider 5 > BAAB 
it generates 5 > BAA 
5 > ААВ 
5 > ВАВ 
S> ВВ 


Theory of Computation 


$ э АА 

55 АВ 

5 BA 

SB 

SoA 

considerA —^042  itgeneratesA— 02 

considerA —240 itgenerates A > 20 

consider B > AB it generates В > А, В > B 

consider B> 1B it generates B > 1 

The equivalent grammar G' = (V, T, P', S) 

Where V' = (S, А, B) 

T = {0, 1,2} 

5$ =5 

P' = {S > BAAB | ВАА | ААВ | ВАВ | ВВ | АА | АВ | ВА | B | А 
A > 042 | 240 | 02 | 20 
B5AB|1B|A|B|1) 


— arm — — —— 


find a CFG, without € - productions equivalent to the following grammar 
5 > ABaC 
A э ВС 
В -ЫЕ 
С-ПБ] Е 
D d) 


— — amm — — 


Step 1: Construction of a set of null able variables 


м, = (В, С} [Since B > Е, C2 €] 
w, = (B, C) U {А} [Since A > BC] 
= {А,В,С} 
w, = {А, B, C) UO = (А, B, C) 
w = (А, В, С} 


Step 2: Construction of P' 
Production whose R.H.S with no nullable variables are 
Bob 
сәр 
D>b 
consider $ > ABaC 


mal Forms for CFG 


itgenerates S— ABa 
5 BaC 
5 ә Аас 
5>ас 
S> Аа 
5 Ba 
Sa 
consider A > BC it generates, A > B, A> С 
The equivalent grammar without € - productions G'- (V', T, P', S) 
where V' = (S, A, B, C, D) 
a, b, d) 
5$ =5 
P' = (S ABaC | ABa | BaC | Аас | aC | Aa | Ba | a 
A2 BC|B|C 
Bob 
CD 
Dd) 


Consider the following grammar and eliminate all € - productions, without chan 
the language generated by the grammar. 


5 > Дад 


A > Sb | сс | € 
C > CC | abb 


— — q — —— 


Step 1: Construction of a set of nullable variables 


w, = {A} [Since А > Е] 
w, ={A}U@ 

= {A} 
w = {A} 


Step 2: Construction of P' 
consider $ э Аа А  itgenerates 5 > Aa, 5 > aA, S > a, А > sb|bCC 
Nullable variable does not occur in RHS of the production A 
The equivalent grammar G'- (V, T, P', S) 
where V' = (S, A, С} 
T = (a,b) 
5 =5 


Theory of Computation 


P' = (5 АаА|Аа|аА|а 
А > Sb|bCC 
C CC|abb) 


Рповієм 8 


Remove the є - production from the following CFG 
SoXYX 
X 20X|e 
Y 291X|e 


q< —— — 


йер 1: Construction of a set of null able variables. 
w, ={Х, Y) [Sinnex5 є, Y2 €] 


w, ={Х,Ү} {S} [Since S2 XY X] 
= {Х, YS) 

и, -(XY,SjUO 
={X, Y, S} 

w={SX Y} 


Step 2: Construction of P' 

Consider 5 > X Y X it generates 5 > X X 
SoXY 
S>YX 
Sox 
597 

consider X 0 X it generates X > 0 

consider Y > 1 X it generates Y 1 

The equivalent grammar G' = (V', T', P', S) 

where У" = (S, X, Y) 


T = (0,1) 

5 =5 

Р' = {$ > ХУХ | ХХ | ХУ| YX|X| Y 
X2 0X|0 


Y21x|1 


For the CFG given below remove the € - productions. 
S ~ аа | bSb | € 


— == 


Step 1: Construction of a set of null able variables 


w, = {$} [Since S > Е] 
м, = {$} 06 
= (5) 
м = {$} 
Step 2: Construction of P' | 
consider 5 » aSa it generates S> аа 
consider, $— bSb it generates S— bb 
The equivalent grammar G' = (V', T, P ', 5) where V' = {S} 
T= (a, b) 


P' = {S > aSa|aa|bSb|bb) 


— — erm» — — — 


Eliminate the € - productions from the CFG given below 
A => 0B1 | 181 
В > 0B] 1B] « 


— — a> ——— 


Step 1: Construction of a set of nullable variables. 
w, = (B) [Since B > є] 
м, ={В} 96 
= (B) 
; w - (B) 
Step 2: Construction of P' 
considerA > 0B1  itgenerates A201 
considerA — 1B1  itgenerates A211 
consider B— 0B  itgenerates B0 
consider, B 1B it generates B1 
The equivalent grammar G'- (V', Т, Р, S) 
where V' - (A, B) 
T= (0,1) 


к ee ee $ 


Theory of Computation 


$=А 
P = {A > 0811011181111 
B > 0В|0|1В|1} 


Construct CFG without € - productions from 
S >a | Ab | aba 
A»b|e 
В >b|A 


— —— Zz — — 


Step 1: Construction of a set of nullable variables. 


и, ={А} [Since A ^ €] 
м, = {A} U (B) [Since B > A] 
= (A В} 
м, ={А, В} Об 
= {A, В} 
w = (A В} 


Step 2 : Construction of P' 
Consider $— a [по nullable variables іп RHS] 
consider, $ > Ab it generates 5 > b 
consider, $ > aba [no nullable variables іп RHS] 
consider, А b [по nullable variables in RHS] 
consider, В э b [no nullable variables in RHS] 
consider, В» А [no subsets of nullable variables іп RHS] 
the equivalent grammar G'- (V', T, P', S) 
where И = (S, A, B) 
Т = (a, b) 
5=5 
Р = {S > а | Ab | b | aba 
A>b 
B>b|A} 


Eliminate € - productions from the following CFG. 
5 Xa 
X 5aX|bX|e 


onte io tone ee 
——qQENED — 


Step 1: Construction of set of nullable variables, 


w, = (X) [Since X > €] 
и, ={Х}о@ 

= {X} 
w = {xX} 


Step 2: Construction of P 

consider 5 > Ха it generates 5 > a 
consider X > a X it generates X > а 
consider X > a X it generates X > b 
The equivalent grammar G'- (V*, T, Р, 5) 
where V' = (S, X} 

T= (a, b) 

5=5 

P'z (S2 Хаја 

X aX | a | bX | b} 


Eliminate € - productions from the following CFG. 
5 >ХУ 
X >25 
Y bW 
2 УАВ 
Wz 
А aA| bA| € 
B  Ba| ВЫ] c 


Step 1: Construction of a set of nullable variables 


и, = (A, В} [Since A > Є, B > є] 
w, = (4 В} U {2} [Since Z> A B] 
= {A, В, Z} 
и, ={А, B, Z} {и} [Since w > 2] 
= {А, В, Z, w} 
w, ={А, В,2, w} U Ø = (4, В, Z, w} 


w ={A,B,Z, w} 


Thec utation 


2: Construction of P' 
consider $ ХУ [No nullable variables іп RHS] 
consider X > Zb itgenerates X b 
consider Y 2 БИ” it generates Y > b 
consider Z ^ AB it generates Z >A, Z > B 


consider W > Z [no nullable variables in RHS] 
consider A > aA it generates A > a 
consider A > bA it generates A > b 
consider B > Ba it generates B > a 
consider B > Bb it generates B > b 


The equivalent grammar G'- {V', T, P', S) 
where V' = (S, X, Y, Z и, A, B) 
T - (a, b) 
S=S 
P'={S> ХҮ 
X Zb|b| 
Y>bW|b 
Z—>AB\A|B 
WZ 
A > aA| a|bA|b 
B > Ba| a|Bb|b ) 


4.6 


Consider the production A B. The left hand side of the production and right hand side of 
the production contains only one variable. Such productions are called unit productions. 


Let G = (V, T, P, S) be a context free grammar. Any production in G of the form A — B, where both A 
and B are non terminals is a unit production. 

Having unit productions in a grammar is undesirable because one variable is simply replaced by 
another variable and it adds one more step in the parsing process. 


xampl 


Consider the productions 

A >B 

B >aB|b 
In this example A > B is a unit production and B > aB|b are non unit productions. Since B is 
generated from A, whatever is generated by B can be generated from A also. So we can remove the 
unit production AB and the resultant production will be A aB|b. 


ао 


A unit production in grammar G can be eliminates using the following steps. 
Step 1: Remove all the productions ofthe form A > А. 
Step 2: Addall non unit productions to B; 


Step 3: For each variable A find all variables B such that 4 5g 
ie, In the derivation process from A,ifwe encounteronly one variable ina sententij 
form say B, obtain all such variables. 

Step 4: Obtaina dependency graph for the productions obtained in Step 3. 

For example, if we have the productions 
А-В 
BoC 
C>B 
the dependency graph will be of the form 


eg 


Step 5: From the dependency graph 
(0 ASB 
i.e., B can be obtained from A so, all non-unit productions generated from 
B can also be generated from A. 
(i) AS c 
i.e., С сап be obtained from A 50, all non-unit productions generated from 
Ccan also be generated from A. 
(iii) BSc 
ie. С can be obtained from В, So, all non-unit productions generated from 
Ccan also be generated from B. 
(iv) cS p 
i.e., B can be obtained from C. So, all non-unit productions generated from 
B can also be generated from C. 
Step 6: Delete all the unit productions from the grammar, G. 


Step 7: The resulting grammar, generates the same language as accepted by G. 


Prostem 1 
inate all unit productions from the grammar 
5 -АВ 
Aa 
B Cb 
сәр 
D — E|bC 
Е — d|Ab 
— ш» — — 
Хоп unit productions Unit productions 
5>АВ BoC 
А>а сәр 
Bob DoE 
D>bC Dependency graph for unit productions 


E d|Ab 


from the dependency graph, D > E 
Soll non-unit productions generated from E can also be generated from D. 
The non unit productions from E are E > d|Ab. 
this can also be generated from D. i.e., D > d|Ab. 
The resulting D productions are D > b C, D ^ d|Ab 
from the dependency grapy, CHE. 
$ all the non-unit production from Е can also be generated from C. 
C d | Ab 
from the dependency graph, сър. 
бо all the non-unit productions from D can also be generated from C. 
C bC|d | Ab 
from the dependency graph B 5 C, B Š D, B SE 
$о all the non-unit productions from C, D and E can also be generated from B. 
B—>b|d|Ab|bC 
The final grammar, G ', after eliminating unit productions is б' = (V', T', P', S) 
Where V' ={S,A,B,C, D, E} 
T' ={a,b,d} 
S=S 


6 


Р = {$-АВ 
Aa 
B b|d|Ab|bC 
C bC|d|Ab 
D bc|d|Ab 
E d|Ab) 


Eliminate all unit productions from the grammar. 


5 AB 
A >a 
B >C 
B >b 
сәр 
D >E 
E >a a 
Non unit productions Unit productions 
SAB BoC 
А-а сәр 
Bob D+E 
Ea 
Dependency graph 
From the dependency graph 
DSE д Doa 
CS ECSD ^ Coa 
BSEBSDBSC . Boa 
^ The simplified grammar G' = (V', T', P',S) 
Where V' = (5,4, B, C, D, Е} 
T' = (a, b) 
5 =5 
Р' ={5-АВ 
Aa 


Вәа|Ь 


[neo и Сорнай 


C2a 
Da 
Ea) 


lliminate all unit productions from the grammar 


S УАВ 

А эр 

D >a 

BF 

F >b 

— qD _ 

Non unit productions Unit Productions 

5 >-АВ A2D 

Da BF 

F >b 
Dependency Graph From the dependency graph 


0—0 ASD - A>a 
© Ф) BSF с. Bob 


The simplified grammar without unit productions is б' = (T. PS) 
where V' = (S, А, B, D, Е} 


T' = (a,b) 

S=S 

р'={5- АВ 
Da 
Fb 
А-а 


Bb) 


PnosLEM 4 


Eliminate unit productions from, 
$ Aa|B|Ca 
BaB|b 
C5Db|D 
D-E|d 
Eab 


—_ liz —— — 


Non unit productions Unit productions 
S Аа | Са SoB 
B>aB\b сэр 
C2Db DE 
Dd 
Eab 
Dependency graph From the dependency graph 
© (8) SSB ^ SoaB|b 
D>E ~ D-ab|d 
(c) (D) (E) CS E CSD ^ C2Db|ad|d 
The final grammar without unit productions is G' = (V', T', P', 5) 
where V ={S, B, C, D, Е, A} 
T' = (a,b, d) 
SzS 
P' ={S> Aa | Ca | aB | b 
B>aB|b 
C>Db|ab|d 
D >d | ab 


E>ab} 


Theory of Computation 


РвовьЕМ 5 


minate unit productions from the grammar 


$ 5A0|B 

В -А| 11 

A —0| 12| В 

—— q 
unit productions Unit Productions 

S A0 SB 

В 11 B>A 

A >0]12 A>B 


From the dependency graph 
BŠA д B211|0|12 
АЪВ 4 $A20|12|11 
SŠB,SŠA д $240|11|0|12 


eresultant grammar G' = (И, Т',Р', S) 


here V' - 45,4, В} 
T' = {0, 1, 2} 
$ =5 
P' -(S240|11|0|12 
B511|0|12 


A>0|12|11} 
Рповієм 6 


liminate unit productions from the grammar 


S 5A|bb 
A >B|b 
B S|a 
— — q — — 
Jon-unit productions Unit Productions 
S bb 59А 
A2b А-В 


Boa BoS 


Normal Forms for CFG 


Dependency Graph From dependency graph 
ASBASS ы A2b|a|bb 
Жош | SŠB,SŠA ^ S>b|a|bb 
BŠS,BŠA д B>a|b|bb 
The resultant grammar G' = (V ', Т', P', S) 
Where V' ={S,A, В} 
T' - (a,b) 
5$ =5 
P' ={S>b |a | bb 
A>b|a|bb 
B>b |a| bb} 


Remove unit production from 
5 >0A|1B|C 


A +05100 

В э1|А 

С >01 

—— qa —— —— 

Non unit productions Unit Productions 

5 20A4|1B Sc 

А 20S|00 BoA 

B1 

C201 
Dependency Graph From dependency graph 

G © 5%С д $20A|1B|01 


ВЪА 2 B>1|0S|00 


The resultant grammar G' = (V', T', P', S) 


Where V = (5,4, B, C} 
T = {0, 1} 
$ =5 


P' ={5- 04|18 |01 


Theory of Computation 


A 05100 
B > 1| 0s|00 
C01) 


РвовьЕм 8 


inate unit productions from, 
S эА|0С1 

A 2B|01|10 

с 5 CD 


———qEED — 


unit productions Unit productions 
S 20C1 S2A 
A + 01/10 А-В 


АЪВ 2 A201|10 
5% В,5ЪА 7 $200C1]|01|10 
resultant grammar G' = (V', Т.Р 
ere V' = {5, А, С, D) 
Т' = {0,1} 
$ =5 
P'2(S20C1|01]10 
А 01110 


сэ ср} 


Prosiem 9 


limplify the given CFG 
5 5a|aA|B|C 
A 5aB|^ 

B aA 

€ 2cCD 

D „ааа 


rmal Forms for С 


There is no € - production. Unit productions are there, .. so eliminate. 


Non unit production 


S—a|aA 
A2aB|^ 
Вэад 
C>cCD 
D > ааа 


Dependency Graph 


Unit Productions 
5>В 
$—C 


From dependency graph 


From dependency graph 


55с 
SocCD 


The resultant productions after eliminating unit productions is 
P' ={S—>a|aA|cCD 

A2aB|^ 

BaA 

CcCD 

D > ааа} 

Elimination of useless symbols 


Sa 


$ SAD 
A^ 
D> ddd 
SAD | SADB S>aA 
Вад 
SADB| SADB A>aB 
SADB| SADB - 


The resulting productions are 


{S>a|aA 
А-^ | аВ 
В>аА 

D ааа} 


s5p 
SaA 


Sa 


$29aA 
42^ o^ SAB 
Аав 
В-аА a^ SAB 


г. The simplified grammar С, = (V, T, P, 5) 
where V, ={5, А, В} 


T, ={а,^} 

5 =5 

P, ={5>а|аА 
А->^|аВ 
Вэад} 


o n 


Simplify the grammar 
$2AACD 
A—aAb|^ 
СэасС|а 
DaDa|bDb|^ 


— — q 


There is no € - production and unit productions. 
Elimination of useless symbols 


AGD | SACD 5 > AACD 


SACD|SACD Е 


The resulting productions are 


S э AACD 

A —aAb|^ 

C >aCjaD >a 

D a|b D b|^ 

= м 5 
S>AACD - LSAGD 
A~>aAb|* 
Ca Cla ab,^ | SACD 
D-aDa|bDb|^ 


Since there is no useless symbols, the simplified grammar is the same as the given grammar 


When the productions in context free 


Brammars are made to satisfy certain restrictions, 
then CFG is said to be in normal form. 


Some of the normal forms are 
* Chomsky Normal form and 


* Greibach Normal form 


CNF puts restrictions on number of 


symbols on the right hand side of a production. Thatis 
in CNF the right hand side of a production cannot contain more than two symbols. It can be 
a single terminal or two nonterminals. 


Let G= (V, T, P, S) bea context free 
are of the form. 


А- ВС (о) А-а 
Where A, Band C are non terminals and a is aterminal. 


grammar. The grammar Gis said to be in CNF ifall the productions 


| 


Theory of Computation 


xample : 


А SA|b is in СМЕ. 
‘The grammar 
$ AS|AAS 

A^ SA|aa 
not in CNF beacuse 5 > AAS contains three nonterminals and A > аа contains two terminals which 
not allowed in CNF. 


CFG can be converted to CNF using the following theorem. 


йг every CFL, without € generated by a grammar С, there is an equivalent grammar is in 
(NF such that L (С) = L (G`) 


let G = (V, T, P, 5) be the CFG generating a language. We construct G = (V, T, P, S) which is 
InCNF as follows. 

йер 1: Eliminate € - productions, unit productions and useless symbols from the 
grammar G. 


Step 2: Arrange in sucha way that all bodies of length two or more consist only of variables. 
For every terminal, 'а' that appears in a body of length two or more, create a new 
variable say A with a production А > a. Now use A in place of a, So that every 
productions has a body i.e., either a single terminal or atleast two variables and no 
terminals. 

Step 3: Break bodies of length three or more into a cascade of productions, each with a 

body consisting of two variables. 

Break those productions А > B, В,_ __ By, for K > 3 into a group of productions 

with two variables in each body. 

i.e. introduce К - 2 new variables. C, С, Ск. 

The original production is replaced, by the K - 1 productions 

А >В, С, 
C, -В,С,___ C, 


2--- кз 


=й. С, 


-2 Ce. 
Ce-a ЭВ, В 


k-2 K 


Thus we get G, in CNF. Hence proved. 


Рковієм 1 


Consider the grammar G = ({5, A, B), (a, b}, P, S) 
where P={S>bA|aB 

А-ЬАА | а5|а 

В > aBB |bS|b 
Find ап equivalent grammar іп CNF. 


a 


Step 1: No useless symbols, € - productions or unit productions. 
A >a 
B >b 
These productions are already in CNF. 
Step 2: Replace terminals by variables 
5 —bA is replaced by S>C,A, C,>b 
S ^5aB is replaced by SOCB, Ca 
А —bAA  isreplaced by 4A2C,AA, C, 5b 
А aS  isreplaced by A2CS Ca 
B >аВВ is replaced by B>C,BB, С, эа 
В 5 isreplaced by B>C,S, C,>b 
Step 3: Restrict the number of variables on right hand side to two. 
А >C,AA isreplaced by A2C,D, D,2AA 
B-C,BB isreplaedby | B CD, D,>BB 


The final grammar in CNF is obtained by combining all the productions in Step |} 
Step 2 and Step 3. 
The grammar in CNF G' = (V, T,P,S) 
Where V = (5,4, B, C, C, D, D) T = {a,b} $=$ 
P'-($2C,A|C,B 
А C,S|C, D, [а 
B C,S|C, D, |b 
D,2AA 
D,>BB 
C, ^a 
C, b) 


PROBLEM 2 


educe the following grammar to CNF 
$ -АВа 
А 25aab 
В Ac 


Step 1: No unit production, € - productions and useless symbols. 
Step 2: Replace terminals by variables. 
S ABa, isreplaced by $-АВС, C,2a 
А aab, isreplaced by A2 C,C,C,, C, a, Cb 
B Ac, isreplaced by ВАС, Cc 
Step 3: Restrict the number of variables on the RHS to two 
S -АВС, is replaced by SAD, р, BC, 
А 2C,C,C, is replaced by A2C,D, D, С, С, 
The grammar in СМЕС = (V, T, P, S) 
where V. = (SA, B, D, D, C, „сд T= (a, b, c) 
P' ={S>AD, 
A>C,D, 
B>AC, 
D, BC, 
D, C,C, 
C,2a 
C, b 
Cc} 


Reduce the grammar into CNF 
5 aXX 
X —aS|b Sja 


an 
и 
vn 


Step 1: No useless symbols, € - productions and unit productions X > a, already in CNF. 


Step 2: Replace terminals by variables. 
S aXX, isreplaced by $>С,ХХ, С,>а 
X aS, isreplaced by хәс,  C,^a 


X —bS, isreplaced by X>C,S, Cb 


b 


Step 3: Restrict the number of variables on the RHS to two. 
5 —C,XX, isreplacedby S—>C,D, р, э ХХ 
The grammar іп СМЕ G' = (И, T', P', S) 
where V' = (SX, D, C, C,) T' = (a, b) $=$ 
Р' ={5->С, 0, 
X>C,S|C,S 
р, ХХ 
С, эа 
C,2b) 


Reduce the following grammar into CNF 
$ 20A|1B 
А 2044]|15|1 
В >1BB|0S|0 


Step 1: No useless symbols, Е - productions and unit productions 
A 21, В 0, already in СМЕ 
Step 2: Replace terminals by variables 
S 04A, isreplaced by S>C,A C,20 
$ 1B, isreplaced by So9CB C21 
A 2044 isreplaced by A2 C,AA, C,20 
A >15, isreplaced by A2CS C21 
В —1BB, isreplacedby ВУС, ВВ, С, >1 
B 0S, isreplaced by BoC,S, С, 0 
Step 3: Restrict the number of variables оп the RHS by two 
A эС,АА, isreplacedby A-C,D, D,>AA 
B —C,BB, isreplacedby B-—C,D, р, э ВВ 
The equivalent grammar in СМЕ С = (V, T, P,S) 
where V. = (S4, B,D, D, C, C,) T- (0,1) SAS 
р' ={S>C,A|C,B 
A>C,S|C,D,|1 
в с,51с,р,10 


р, -АА 
D,>BB 
G>0 
6,21) 


________ arm 


Reduce the following grammar G to СМЕ. Gis 
S задр 
A 5aB|bAB 
B >b 
D >d 


—— qD — 


Step 1: No useless symbols, € - productions and unit productions. 
B >b 
р > d, already in CNF. 

Step 2: Replace terminals by variables 


S >aAD, is replaced by S>C,AD, С, эа 
А ав, іѕ replaced by АЭС, В, С, эа 
A > bAB,is replaced by А-С,АВ, C,7b 


Step 3: Restrict the number of variables on the RHS by two 
5 >С, AD, is replaced by S>C,D, D,2AD 
А >С, AB, is replaced by A2C,D, D,2AB 
The equivalent grammar in CNF 6 = (И, T, P',S) 
Where V' = {S, A, B, D, D, D, C, C,} 
T = (a,b, d} $=$ P'={S>C, D, 
A>C,B|C,D, 
D, -АБ 
D,>AB 
Bb 
Dd 
C,2a 
C, 2b) 


Normal Forms for ; 
Рповієм 6 


Find a grammar in CNF equivalent to 
S 5aAbB 
А >аА|а 
B >bB|b 


Step 1: No useless symbols, € - productions and unit productions. 
Aa 
В >b, already іп СМЕ 
Step 2: Replace terminals by variables 
S 5aAbB  isreplaced by 
5 -САС,В 
С, эа 
C, 2b 
А >аА, isreplaced by A2C,A C,a 
B >ЬВ, isreplaced by BOCB Cb 
Step 3: Restrict the number of variables on the RHS by two. 
S >С, AC,B,isreplacedby SCD, 
D,2AD, 
D,2C,B 
The equivalent grammar in CNF С = (V, T, P, S) 
Where V' = (S, A, B, D, D, C, С,} T= (a, b) 5=5 
P' ={S>C_D, 


Find a grammar in CNF equivalent to the grammar 
S>~S|[S+S]|Plq 
where Т = {~, [, +], p,q} 


ry of Computation 


— — q —— — 


1: No useless symbols, € - productions and unit productions. 
$ әр 
5 >q, already in СМЕ 

2: Replace terminals by variables. 


S > ~ 5, 15 replaced by 59с,5 C2- 
$ >[S+S],isreplacedby | $—C,SC,SC, 
CG[ 
С,>+ 
Gj) 


p3: Restrict the number of variables on the RHS by two. 
S >C,SC,SC,,is replaced by S >C,D, 
D, >SD, 
D, >C, D, 
D, >SC, 
The equivalent grammar іп CNF G' = (V, T, P', 5) 
Where V. = (SD, D, D, C, C, C, C,) 
Т ={~ [+]. p.q} 
5 =5 
Р = {9 SIC, D,IpIq 
D,>SD, D,7C,D, 0,956, 
сэ ~ Cat a C77} 


Convert the given grammar to CNF 

$ -АВ|СА 

В -ВС|АВ 

Aa 

C -авь 

———— AEN» — — 

Step 1: No useless symbols, € - productions and unit productions. 
S 29AB|CA Aa 
B >ВС| АВ, C> b, already іп СМЕ 


гта! Forms for СЕС 


Step 2: Replace terminals by variables C > a B, is replaced by С C, В,С, > a 
Step 3: Not applicable 
. The equivalent grammar in СМЕ G' = (V', T, P P', S) 
where И = {5, А, В,С} T = (a, b) 5=5 
Р ={5-АВ|СА 

Вә ВС|АВ 
Ауа 
СЭС, В|Ь 
С, >a} 


Write the equivalent СМЕ, for the following grammar. 
SoAB 


Aaab 
B>aAC 


—— q — — 


Step 1: No useless symbols, € - productions and unit productions 
5 > AB, already іп СМЕ 
Step 2: Replace terminals by variables. 


A —aab,isreplaced by A>C,C,C, 
C a 
Cb 
B >аАС, is replaced by B>C,AC, С,>а 


Step 3: Restrict the number of variables on the RHS by two 
А >С, С, С,, is replaced by A2C,D,, D,2C.C, 
В >C,AC, is replaced by B>C,D,, D,2AC 
The equivalent grammar in СМЕ С = (V, T, P, S) 
where V = {S, A, B, D, D, C,C,) T = (a, b) 5=5 
P -(SOAB 
АЭС, D, 
B>C,D, 
D, >C, С, 
D,>AC 
C, 7a 
C, >b} 


ce the grammar, into CNF 
5 АОВ 
А АА |050 
В = 0ВВ|15|1 


1: No unit productions, Є - productions and useless symbols. 
A 2AA|0 
В > 1, already іп СМЕ 

2: Replace terminals by variables. 
S — A0 B, is replaced by SoAC,B, C,20 


A —0S,is replaced by A>C,S, C,70 
B +0BB,isreplaced by ВС, ВВ, C,>0 
В ~ 15, 15 replaced by B>C S, C71 


Step 3: Restrict the number of variables on the RHS by two. 
5 ә AC, Bis replaced by S>AD, D,>C,B 
B 5C,BBisreplaedby В-С,0, D,>BB 
The equivalent grammar in СМЕ С = (V, T, P, 5) 
where V ={S,A, B, D, D, C, C,) 
T - (0,1) 
$ =5 
P'-($2AD, 
А-АА|0| С, 5 
B>C,S|C,D,|1 
D,2CB 
D,— BB 
c,70 
6,21) 


In CNF there is restriction on the number of symbols on the right hand side of the production 
{ie.,) it should be either two variables or one terminal. 


In GNF there is no restriction on the length of RHS of a production but restrictions on the 
position in which terminals and variables appear. 


Let G = (V, T; P, S) bea СЕС. The CFG is said to be in GNF if all the productions are of the form. 
А -aawhereae€ Tandae V* 


(ie.,) The first symbol on the right hand side of the 
or more number of variables. 


The grammar 


production must be а terminal followed by 


S 5aA|bBB|bB 
А —aA|bB|b 
B >b 
is in GNF since the RHS of all the productions is a followed by zero on more variables terminal, 


Example 2 


The grammar 


5 -АВ 
А —5abB 
В 5abb 
is not in GNF as the RHS of the production 5 -+ AB, is not in the form А > аа where a € T and a € V. 


Let G - (V, T, P, S) bea CFG, generating the language L without €. An equivalent grammar (j| 
generating the same language exists for which each production is of the form 


Aaa 
Step 1: Obtain the grammar in CNF 
Step 2: Rename the non-terminals to A1, A2, АЗ, ........ 
Step 3: Using substitution method, obtain the production to the form 

A, 2Aafori«j 

where a € V*. 

Step 4: After substitution, if the grammar has left recursion, eliminate left recursion. 
Step 5: Repeat step 3 andJor step 4 to get the grammar in GNF. 


Theory of Computation 


Рповієм 1 


C зав | bis already in GNF. 
production 5 > СА is іп СМЕ. It needs to be changed to СМЕ. 
istitute the production С > a B | b into 59 СА 


5 ЭСА 
-5aBA|bA 
ich is in GNF. 
n we can write equivalent GNF as 
S -аВА|ЬА 
Aa 


C >aB|b 


Рковієм 2 


ere are no useless symbols, no € - productions, no unit productions. 
lp 1: Transform С into CNF. 
Following productions are already in CNF 

S AB 

Aa 

B >b 


The production A B $ B need to be converted to СМЕ. 
A Вр, 
D, SB 
Grammar G is in CNF 
5 -АВ 
A 5 BD,|a 
D, SB 
B >b 
Step 2: Rename the variables toA,A4,A, ..... 
5 =A,;A=A,;B=A,;D, =A, 
Now the grammar can be re-written as 
A, 2A,4, 
A, 2A,A,|a 
A, >b 
А, ЗА, А, 
Step 3: Order the productions and remove left recursion where necessary. 


The production A, > A, A, need to be changed since the production is not in 
form 


A, 2A afori«j 
* Substitute А, > A, A, in A, Production 
A,>A,A,A, 
* Substitute А, > А,А, [а in A, Production 
4,24A,4,4, А, |a А, А, 
* Substitute А, > b in A, Production 
А, >БА, А, А, |aA,A, 
All the productions are now properly ordered 
А, 2A,A4, 
2A,4, |a 
>b 
A, 2 bA,A,A, |a A,A, 
Step 4: Substitute backward to get GNF 
* Substitute A, b in A, 
А, ЭБА, |а 
* Substitute А, > bA,|a in A, Production 
А, 2 bA, А, [а А, 


05: The final grammar in СМЕ 
А, >bA,A,|aA, 
A, ЭВА, [а 
А, >b 
А, >ЬА, А, А, | а А, А; 


Prostem 3 


wert the following grammar into GNF 
5 -А 
A 25aBa|a 
В bAb|b 


— — duum — — 


fere are no useless symbols, по € - productions. 
ove unit production 5 — A. By substituting A production into S. 
S -аВа|а 
p1: Transform С into СМЕ G' 
(a) Substitute terminals on RHS with variables. 

; 5 э aBa|a is replaced by S>C,BC,|a C,2a 
А  аВа|а is replaced by A-2CBC|a C,>a 
В > bBb|b is replaced by B>C,AC,|b C,>b 

(b) Breakdown the rules to get the grammar G' in CNF. 
S2CD|a D,2BC, Ca 
A 2C,D,|a 
BCD,b D,>AC, C,>b 
Жер 2: Rename the variables to A,, A, , Hess 

S =A, A=A,B=A, С,=А,С,=А, D,=A,D,=A, 

2A,A,|a 

ЭА,А, |а 

—A.A, | b 

2A, 

AA 

a 


>b 


Normal Forms for CFG 


Step 3: Order the productions and remove recursion where necessary. 
The productions 
A, ЗА, А, 
А, >А, А, 
need to be changed since the productions are not in the form 
А, > А a for i«j 
A, ЗА, А, 
* Substitute А, > А, Ар in to A, 
A, 4,4, A,| b A, 
* Substitute А, — b into A, 
A, bA, A,|bA, 
A, 2 A, A, 
• Substitute А, > A, A, | ато A, 
A, > А, АБ Аза A; 
* Substitute А, э a in to A, 
A, ^ aA, Аза A, 
All the productions are now properly ordered. 
A, 2A,A,| a 
—A,A, |a 
— AA, | b 
2a 
>b 
>bA,A,|bA, 
2aA,A,|aA, 
Step 4: Substitute backward to get GNF. 
* Substitute А, >a in to A, A, 


A,2aA,|a 
A,2aA,|a 
A,2 A,A,|b 
* Substitute А, >a in A, 
A,2bA,|b 
Step 5: The final grammar in GNF 
A, 2aA,|a 


Theory of Computation 


>b 
>bA,A,|bA, 
>aA,A,| aA, 


Convert the following grammar in GNF 
5 >AB1|0 
А >00A|B 
В э 141 


— — q —— — 


There are no useless symbols, no € - productions. 
Remove unit production A > B by substituting B into A. 
А 2004141 
Step 1: Transform G into СМЕ С. 
(a) Substitute terminals on RHS with variables. 


S >АВ1 | 0 replaced by, 5>АВС,|0 С, >1 
А —00A[1A1 replacedby A>C,C,A|C,AC, С,>0 
В > 1A1 replaced by, В->С,АС, 

(b) Breakdown the rules to get the grammar 6 in СМЕ. 
S > ABC, | 0 replaced by S>AD,|0 D,— BC, 
А ә C,C,A replaced by A2C,D, D,2C,A 
А 2 С,АС, replaced by A>C, D, D,>AC, 
В — С,АС, replaced by B>C,D, 
C, 70 
C, 21 


Step 2: Rename the variables to А, А„А,....... 
5 =А„А = А„В = A, C,7 A, C, =å; D, =A, D, = A, D,7 A, 
A, 24,4,|0 
A, ЗА, А, | А, А, 
A, 2A.A, 


1 


2 


3 


А, 20 
А; 21 
A, >A, А, 
А, ЭА,А, 
A, 24,4, 
Step 3: Order the productions and remove recursion where necessary 
The productions 
A, 24,4, 
А, >A,A, 
A, 24,4, 
need to be changed since the productions are not in the form 
A, ~Aafori<j 
A, ^t А, А; 
* Substitute A. > A,A,A, into A, 
A A. А, А; 
* Substitute A, >1 into A, 
А. ТА, А; 
А, = A, A, 
* Substitute А, > 0 into A, 
4,04, 
A, 2i A, А; 
* Substitute A, 74,4, | A, A, into A, 
A, А, А, А, | А, A, A, 
* Substitute А, +0 А, — 1into A, 
A, 04, A, A, A, 
All the productions are now properly ordered. 
A, 24,4,|0 


A, 204,4, | 14,4, 


р4: Substitute backward to get GNF 
* Substitute А, > А, 
A, > 1A, into A, 
* Substitute A, A, in A, 
A,204,A,]14, 
• Substitute A,in A, 
A, > (04, | A) А, | 0 
А, 204, 4,1 14,4,1 0 
р5: The final grammar іп GNF 
204,4,1 14,4,10 
A, 204,|14A, 
A, 21A, 
A, 20 
21 
>14, А, 
04, 
204,4,| 14,4, 


PnoaLEM 5 


: The grammar is already in CNF. 
йер 2: Rename the variables to A,, A, A, . ...- 
Let A =A,B=A,C=A, 
A, >А, А, 
А, > А, А, |b 
A, >А, А, |а 
Step 3: Order the productions and remove recursion where necessary. 
The productionsA, +A, А, need to changed sincethe productions are notintheform 
A > A afori«j 
A,2A,A,]a 


* Substitute А, > А, А, into A, 
4,2 А,А,А,| a 
* Substitute А, > А, А, |b into A, 
A, 24,4, А.А, ЬА, А, | a 
Since A, production is having left recursion, eliminate it. 
A, 2 bA,A, | aZ 
Z 9AA,AZ|e 
eliminate € production, by eliminating nullable variable Z in the productions, 
A, 2 bA.A,Z|bA,A, | aZ|a 
Z 54,A,A,214,4,4, 
Step 4: Since all the productions are properly ordered. Substitute backward to get СМЕ 
* Substitute A, in А, production 
A, ЭА,А | b 
A, > (БА, А, Z |bA, A, | aZ| a) | b 
A, 2 bA,A,ZA, | bA,A, A | aZA, | aA, | b 
* Substitute A, in A, production 
A, 24,4, 
A, > (БА, А, 2 А, БА, A, A, | aZA, | aA,| b) А, 
A, 2 bA,4,2A, A БА, А, А,А,| а 7А,А, | aAA, | b A, 
* Substitute A, in Z production 
Z 9A А, А, | А, А,А,2 
7 (БА, А, ZA, A, | БА, А, А, А,| а ZA, А, [а А, А,| BA) А, AJ 
(БА, А, 2 А, А, | А, А, А, А,| а 7А, А,| а А, A | b A) А, А,2 
РАБА, А, ГА ААА БАА, А, А, А, А,| а А, А, А.А, а 2 А, А.А, А] 
bA,A,A,|bA,A,ZA,A,A,A,Z\b A,A,A,A,A,A,Z а А, A,A,A,2| 
aZA, А, A, A,Z| bA, А, A,Z 
Step 5: The final GNF is 
A, ЭЬА, А, А, А, | aA, А, БА, 4,24,4,| а ZA, A, | b A, 
A, 2 bA,A,A, | aA, |bA,A,ZA, | aZA,| b 
A, 2 bA,A,|a |bA,A,Z|aZ 
Z >bA,A,ZA,A,A,A,| bA,A,4 4,4, А, | а А, А, А, А, | а 2 А, A,A Al 
БА, А.А, | А, А, 2А, А, А, А, ZÍIb A, A, А, А, А, A, Дад, A, А,АД 
aZA,A,A,A,z|bA,A,A,Z 


* Substitute А, > A, A, into A, 
A,2A,A,A,|a 
+ Substitute А, — A,A, |b into A, 


A, 24,A,A4,A,| БА, А, | a 
Since A, production is having left recursion, eliminate it. 
A, ЭВА, А, | aZ 
Z 2A,A,A,Z| e 
eliminate є production, by eliminating nullable variable Z in the productions, | 
A, 29bA,A,Z|bA,A, | aZ|a 
Z >A,A,A,Z|A,A,A, 
Step 4: Since all the productions are properly ordered. Substitute backward to get GNF. 
* Substitute A, in A, production 
A, 2A,A,|b 
А, > (БА, А, 2|ЬА, А,| aZ| a)A,| b 
А, 2bA,A,ZA, | БА, А, А,|а2А, | a A,| b 
* Substitute A, in A, production 
A, >А, А, 
А, э (БА, А, 2А, |БА,А, А, |а2А, |аА,|Ь) A, 
А, 2bA,A,ZA А, |ЬА,А, АА, |а2АА, |ад,А, | bA, 
* Substitute А, іп 2 production 
Z УА А, А, | А, А,А, 2 
> (БА, А,2А, А, | БА, А, А, А,| aZA, A,| а А, А, | BA.) А, A,| 
(БА, А,2А, А, | БА, А, А, 4,|a ZA, A,| а А, 4,| БА.) А, А,2 
Z 9bA,A,ZA A,A,A,| БА, А, А, А, А, А,| а А, А,А,А, | а 2 A, A, А, А] 
bA,A,A,|bA,A,ZA,A,A,A,Z|b А, 4,A4,A,4,4,Z | a А, A,A,A,2| 
aZA,A,A,A,Z|bA,A, A,Z 
Step 5: The final GNF is 
А, -ЬА, А, А, А, | aA, 4,| DA, A,ZA.A,| aA, A, | DA, 
А, 2bA,A,A, | aA, |ЬА,А, 2А, | aZA,| b 
A, 2bA,A,|a| bA,A,Z| aZ 
Z 29bA,A,ZA, АА, АДЬА, А.А, А, А, А, | а А, А, А, А, | а 2 А, А, AA] 
b A, A,A, | b A, A, Z A, A, A, A, Z|b A, A, A, A, A, А, Z|a А, А, А, А, Д 
a z A, A, A, A,z|b A, А, А, Z 


— — arm 


Convert the following grammar in GNF 
$ 5AA|0 
A >SS|1 


— — q — — 


Step 1: The grammar is already in GNF 
Step 2: Rename the variables as A,, A, A, . .. ... 
Let 5 =A,A=A, 
A, 24,4,10 
А, ЗА, А, |1 
Step 3: Order the productions and remove recursion where necessary. 
The production 
А, 24,4, 
need to be changed since the productions are not in the form 
A, эда i<j 
• Substitute A, in A, 
A, А, А/1 
А, > (4, А, 10) А, 11 
A, ЗА, А, А, |04, |1 
A, production is having left recursion eliminate it. 
A, > (0А, | 1) 2 
Z -А,А, 2 | Е 
Eliminate є production by eliminating nullable variable Z in the productions. 
А, 204,2|04,]12]1 
Z эА,А,7|А,А, 
Step 4: Since all the productions are properly ordered, substitute backward to get GNF. 
+ Substitute A, into A, 
A, 24,40 
A, (04,2104, [12114,10 
А, 204,24, |0, 4,| 124, | 14, |0 
* Substitute A, into 2 
Z 2A,AZ|A,A, 


mal ns for 


Z 25(04,2104,112|1)4, ZI (04, 2| 04, [121 A, 

Z —04,24,2|04, А, 21124, 2 | 14, Z|04, ZA, |04, А, | 12A, | 14, 
Step 5: The final GNF is given below 

А, 204,24,|04,4,|124,| 14,10 

А, 204,2|04,|12|1 

Z 504,24,2]04,4,2]124,Z| 14, Z| 04, ZA, [0 A, 4,| 124,| 14, 


Conversion of CFG to PDA is possible only if the CFG is in GNF. The steps to be followed to 
convert a grammar to its equivalent PDA are shown below. 


1. Convert the grammar to GNF. 
2. In state д, when 2, is on the top of the stack, without processing any input symbol, 
push the start symbol S on to the stack and change the state to 4. 
ô Gy €, Zo) = (q, S 24) 
3. For every production of the form A > a a where a € V* introduce the transition 
ô (4, a, A) = (4,9) 
4. Finally in state q,, without processing any input symbol change the state to q, which 
is an accepting state. 


5 (q, © 2) = (qz Z) 


-_ a 


For the grammar 
5 ^5aABC 
A >aB|a 
B >bA|b 
Ca 
obtain the equivalent PDA. 
— — q 
The given CFG is already in GNF. 
Let q, be the start state and z, be the initial symbol on the stack. 
Step 1: Push the start symbol $ on to the stack and change the state to q, The transition 
of this can be of the form 
5 (y 62) = (9,52) 
Step 2: For each production A > a a where a € v* introduce the transition 
8 dy aA) = (ya) 
This can be done as shown below. 


Normal Forms for CFG | am 


Z 5(04,2104,112| 1) А, 21 (04, Z|04, |1Z | 12) A, 

Z 204,24,2104,4,2|12A, 2| 14, Z|0 4, ZA, | ОА, 4, | 1 ZA, |14, 
Step 5: The final GNF is given below 

А, 204,24,104,4,] 124, 114,10 

A, >0A,Z|0A,|1Z]1 

Z 204,24,2104,4,2|124,Z|14, Z| 04, ZA, ОА, 4,| 1 24,]14, 


Conversion of CFG to PDA is possible only if the CFG is in GNF. The steps to be followed to 
convert a grammar to its equivalent PDA are shown below. 
1. Convert the grammar to GNF. 
2. In state 4, when 2, is on the top of the stack, without processing any input symbol, 
push the start symbol S on to the stack and change the state to qy 
5 Gy €, Z9) = Gy S 2) 
3. For every production of the form A > a a where a € V* introduce the transition 
5 (Ч, a, A) = (4,9) 
^. Finally in state 4, without processing any input symbol change the state to q, which 
is an accepting state. 


б Gy €, 2) = (qx Zo) 


— — — arm 


For the grammar 

S > адвс 

A >аВ|а 

B —bA|b 

C >a 
obtain the equivalent PDA. 

—— чаю —— — 

The given СЕС is already in СМЕ. 
Let q, be the start state and z, be the initial symbol on the stack. 


Step 1: Push the start symbol S on to the stack and change the state to q, The transition 
ofthis can be of the form 
6 Gy €, 2,) = (q, 52,) 
Step 2: For each production А — a a where a € v* introduce the transition 
6 (Ч, а, А) = (а, a) 
This can be done as shown below. 


5 (q, a, S) = (q, ABC) 
5 (q, a, A) = (q, B) 

5 (q, a, A) = (q, €) 
5 (q, b, B) = (q, A) 

5 (q, b, B) = (q, €) 
5 (q, a, C) = (q, €) 
Finally in state q,, without consuming any input symbol change the state to q, 
which is an accepting state. 

5 (9,6,2,) = (qx Zo) 


Step 4: 
. The PDA М for the given CFG can be defined as 
М = (0,2, Г, 8, qy Zy F) 
where Q = (4,4, 4;) 


X ={a,b} 

Г ={S,A,B,C,z,) 

4 -(4,) 

Za ={2,} 

Е ={4,) 
5: is shown below 
5 (qy €, Zo) = (qy S Z) 5 (4, b, B) = (q, A) 
5 (q, a, S) = (q, ABC) 5 (q, b, B) = (9, €) 
ô (q, a, А) = (а, B) 5 (q, a, C) = (q, €) 
5 (q, a, A) = (q, €) 5 (4, € Zo) = (a, Zo) 


— — eum — — —— 


Obtain the equivalent PDA for the given CFG. 
5 ^5aAA 
А >aB 
B >b 
B >b 


— a 


The given grammar is already in GNF. 
Let q, be the start state and Z, be the initial symbol on the stack. 


Normal Forms for CFG E 


Step 1: Push the start symbol $ on to the stack and change the state to q,. The transition 
of this can be given as 6 (q,, €, z,) = (q, S z,) 


Step 2: For each production A a a where a € V* introduce the transition 
5 (q, a, A) = (9,9) 


S—aAA 5 (q, a, S) = (q, АА) 
AoaB 5 (q, a, A) = (q, B) 
А-Ь 5 (dy b, A) = (qx €) 
B>b 5 (q, b, B) = (q, €) 


Step 3: Finally in state q,, without consuming any input change the state to q, which is an 
accepting state. 


5 (dy €,2) = (4,2) 
Step 4: 
* The PDA M for the given CFG cn be defined as 

М =(Q, ET, 8, qy Zy F) 


Where 5: is shown below 
Q ={4,9,9,) 5 Gy © z) = Gy SZ) 
X ={a,b} 5 (q, а, S) = (q, АА) 
Г ={5,A,B,z,} 5 (q, a, А) = (q, B) 
4, 7(4) б (q, b, A) = (4, €) 
z-(n) 5 (q, b, B) = (q, €) 
Е ={q,} 5 (Ч, €, 2) = Gy Zo) 


Construct the PDA for the grammar S > a S bb | а 


— — Фа — — 


The grammar is not in GNF. The GNF of this grammar is 
S -а5А|а 
A >bB 
B >b 


Step 1: Push the start symbol S on to the stack and change the state to q,. The transition of 
this can be given as, 


$ (qy €, ) = (qy $2) 


p2: For each production А > a a where a € V* introduce the transition 
5 (q, a, A) = (9,9) 


5 (q, a, S) = (q, SA) 

5 (q, a, S) = (q, €) 

5 (q, b, A) = (а, B) 

ô (q, b, B) = (q, €) 

p3: In state q, without consuming any input change the state to q, which is an accepting 
state. 


5 (qy € Zo) = (Gy Zo) 


p4: 
The PDA M for the given GFG is 
M = (Q, Х, Г, 8, qy Zy F) 


(2 


Where 6: is shown below 
Q 7(4,4,4;) ô Gy €, 2) = Gy $2) 
У -(ab) ô (q, а, S) = (q, SA) 
Г ={S,A,B,z,} б (q, a, S) = (а, €) 
Ч ={9,} 5 (q, b, A) = (9, B) 
% 70) 8 (q, b B) = (4,6) 
Е ={q,} 5 (qy €, 2) = (9,2,) 


PnosLEM 4 


Маш a PDA to accept the language L = ( w w* | |w] 2 1 for w e (a + b)*} 


— —AEHED —— 


e equivalent CFG to generate the language is 
S 5aSA|aa 
A —bSb|bb 
The grammar is not in GNF. The GNF of this grammar is 

S -а5А|аА 
S 2bSB|bB 
А эа 

B >b 


Step 1: Push the start symbol S on to the stack and change the state to 4,6(q0, 6,2) =(4) 
Step 2: The equivalent transitions for the given productions are 
" а 


5 (q, a, S) = (q,, SA) 
ô (4, a, S) = (q, A) 
5 (q, a, A) = (q, €) 
ô (q, b, B) = (q,, €) 
Step 3: In state q, without consuming any input change the state to q, which is an accepting 
state. 
5 (do €, Z) = (4,,2,) 
Step 4: The PDA M for the given CFG can be defined as М = (Q, X, Г, 5, 4,2 Е) 


Where 
Q = {4,9,9} 6: is shown below 
Y -(ab) 8 (dy € ,2,) = (8,52,) 
Г ={5, А, В, z} 5 (q, а, S) = (q,, SA) 
4, ={4} 5 (4, a, S) = (q,, 4) 
7 ={2} 5 (q, a, A) = (q, €) 


Peg) 


ô (q,, b, B) = (q, €) 
5 (4, €,2) = (qy 2%) 


Construct a PDA equivalence the following grammar. 


S >аА 


А —aABC|bB|a 


B >b 
С >c 


Check whether the string aaabc is accepted by the PDA. 


— a —— 


The given CFG is already in СМЕ Let q, be the start state and Z, be the initial stack symbol. 
Step 1: Push the start symbol. S on to the stack and move to state q, The transitions is 
lly € 2) = (q, $z,) 


P n Transition _ 
$-аА 5 (q, a, S) = (а, А) 
А-аАВС 8 (q, a, A) = (а, ABC) 
A bB 8 (q, b, A) = (q, B) 
А-а 6 (q, a, A) = (q, €) 
B>b 5 (q, b, B) = (q, €) 
Cc 5 (q, 6C) = (q, €) 
йер 3: &(q,, €, 2,) = (q, 2.) 
tep 4: 
The equivalent PDA, М is given by 
М = (0, 2, Г.5,4,2,Е) 
Where 5 is given below 
Q = (4, 4,4) 8 (dy €,z)) = (q, Sz) 
X = {а,Ь,с} 6 (q, a, S) = (а, A) 
Г = (2,5, А, В, С) 5 (q, a, A) = (q, ABC) | (q, €) 
4, ={9,} 6 (q, b, A) = (q, B) 
2, *(z) 8 (q, b, В) = (4,6) 
Е ={q,} б (q, c, C) = (9,6) 


5 (Ч, €, 4) = Gy Zo 
check the acceptability to the string aaabc. 
rivation of aaabc 

S —aA 

— aaABC 

— aaaBC 

— aaabC 

— aaabc 

'cking the acceptability by the PDA. 
(4, €, 2) + (q, aaabc, Sz) 

+ (q, aabc, Az) 
+ (q,, abc, ABCz,) 
+ (q, bc, BCz,) 
| (q, с, Cz) 
| (а, €, z)) 


+ (q,, €, z)) 
(q;, €, 2,) is the final configuration. 
the PDA accepts the string aaabc. 


Convert the grammer into a PDA and check whether the string aaa is accepted by the 
PDA. 


S ^ aAA 
A э aS|bS|a 


— —— шиш» —— — 


The given СЕС is already is СМЕ. 

Let q, be the start state and 2, be the initial stack symbol. 
Step 1: à(q, e, 2,) = (q, Sz,) 

Step 2: 


5 aAA 5 (4, a, S) = (а, AA) 
A aS 5 (4, a, A) = (4,5) 
А-5 ô (q, b, A) = (4,5) 
A>a 8(q, a A) = (q, €) 


Step 3: ó(q, є, z,) = (4„7,) 
Step 4: 
the equivalent PDA, M is given by 


М =(0,Х, 8, quz, F) 
Where б is given below 

Q -(4,4,4,) $(q, €,2,) = Gy Sz) 

Y ={a,b} ô (a, a, S) = (q,, AA) 

Г ={z,,S, A} ô (q, a, А) = (q, S)l(q,, €) 

4, ={,} б (q, b, A) = (q, S) 

2 ={2,} б (q, b, A) = (q, S) 

Е ={9,} ё(9,Є,2,) = (q, 2,) 


To check the acceptability of the string aaa. 
Derivation of aaa 
S — aAA 


Theory of Computation 


— ааА 
— ааа 
ecking the acceptability by the PDA 
(9, Ez) + (а, ааа, Sz,) 

+ (q, аа, AAz,) 

+ (q, a, Az,) 

+ (qy, €, z) 

+ (Gy €, )) 

is the final configuration 
the PDA accepts the string aaa. 


e pumping lemma for CFL s is useful for 
(à) Generating an infinite number of strings from a given sufficiently long string. 
To prove that certain languages are not context free. 


let L be any CFL, then there exists an integer т such that, for any string w € L with 
|w| 2 m, the string w can be split into five parts as w = u v x yz such that 


@ |vy|21 
(b |vxy| sm 
(© Foralli0 uv'xy'zeL 


(onsider an infinite context free grammar С with no unit productions and no 
£- productions. Consider a string w € L (С) with length, т where 


т> (number of productions) x (largest right side of productions) 


This suggests that some variable must be repeated in the derivation of w. 
(onsider u, v, x, y, z : string of terminals with 
S 5uAz 
A-vAy 
Ax 
andw=uvxyz 
The tree of w is 


Following are the strings that can be generated 
(a) Weknow that 
SSuAzASvAyandASx 
SSuAz S5uxz 
^ w=uv’xy’z 
(b) Weknow that 
SSuAzASvAyandASx 
S5uAz5SuvAyzSuvxyz 
. w=uv'xy'z 
(c) Weknow that 
SSuAzASvAyandASx 
55 uAzSuvAyzSuvAyyzSuvvxyyz 
wz-uvxy'z 
In general 
For productions 5 5 u A 24% vAyandA Sx. 
The string generated is 
Ж SuAy SuvAyzSuvvAyyz 5 


SuvvvAyyyz 5 D TE 


Ъ цууу...... уАууу........ yz 
> иууу...... УХУ ани: yz 
Š uvixyz 


Therefore, a string of the form и v ху z for i > 0 is generated by G. Further и УХУЕЕ [ (0) 
implies that, u v/ x y' z € L (G) with | уху | < тапа | уу | > 1. 


Theory of Computation 


| vxy|<m, since A is the | vy | 21 since there are no 
unit and € - production. 


last repeated variable. 


PRoBLEM 1 


low that L = (a" b" с" | n», 1} is not context free 


| the grammar L = { a^ В" c" } we note that, in every string of L, any symbol appears 
le same number of times as any other symbol. Also a cannot appear after b and c cannot 
‘pear before b an so on. 

Жер 1: Assume L is context free. Let n be the natural number obtained by using the 
| pumping lemma. 

Мер 2: Let z = a^ b" с". Then | z | = Зп > n. Write z и v w x y where | vx | > 1. (i.e.,) atleast 
| one of v or x not €. 

Step 3: иумху=а” "с". As 1 < | ух | < п, v or x cannot contain all the three symbols a, b, с 
so (i) v or x is of the form a' b’ (or Б'с/) for some i, j such that i+ j < п (ог) v or x is a 
string formed by repetition of only one symbol among а, b, с. 

When v or x is of the form a’ b /, v? = a' b/ a' Б! (or x? = а! b/ a' b’). As у? is а substring 
of u у? w x? y. We cannot have u у? w х? y of the form а” b" c" so и v^w x^ y € L. 
When both v and x are formed by repetition of a string symbol (eg. и = а' and 
v = b! for some i and j, i < n, j < n) the string и w y will contain the remaining 
symbol say a,. Also a," will be substring of way as a, does not occur in v or x. The 
number of occurrences of one of the other two symbols in uwy is less than n. (recall 
uvwxy = а" b^ с") and n is the number of occurrences of a. So uv»wx'yzuwy€L 
Thus for any chance of v or x, we get a contradiction. Therefore L is not context free. 


PRoBLEM 2 


Show that L - (a" | P isa prime) is not context - free language. 


— —dEEEDP —— 


We use the following property of L. If w € L, then | w | isa prime. 
Step 1: Suppose L = L(G) is context - free. Let n be the natural number obtained by using! 
pumping lemma. 
Step 2: Let P bea prime number greater than n. Then z = a^ € L, we write z= uv ху. 
Step 3: By pumping lemma, и V w x? y = u wy € L. 
So | u wy | is a prime number. say q. 
Let | vx | =r. Then | иу мужу | =q + qr. 


As q + q' is not a prime, u v w x* y € L. This is a contradiction. Therefore L is mt 
context free, 


CFL's are closed under union, concatenation and star. 


If L, and L, are CFL's, then L, UL, L, . L, and L,* also denote the CFL. 
Proof 
Let L, and L, be two CFL's generated by the CFG's 
G, - (V, T, P, S) and 
G, = (V, T, P, S,) respectively. 
Assume that V, and V, are disjoint. 
Case 1: Union of two CFL's is CFL. Let us consider the language L, generated by the 


grammar. 
G, = (У, UV, US, T, UT, P, S,) where 
S, =5, |5, 


P, =P, UP, U{S, >S, | S,} 
It is clear that grammar G, is context free and the language generated by this 
grammar is also context free. 
It is easy to prove that L, = „о. 
if we assume w € L, then the possible derivation of w from S, is 
5, > S, 5 w 
if we assume w € L, then the possible derivation of w from S, is 
S, > 5,5 w 


So if w € L, one of the derivation 
S, = S, or S, = S, is possible. 
In the first case, all the variables in V, and all the terminals in T, may be used to get 
the derivation. 
5, Š w which uses only the production in P, 
In the second case, all variables in V, and all the terminals in T, may be used to get 
the derivation 5,5 w which uses only the production in P,. 
(ie) L, 9L, UL, 
Thus it is proved that CFL's are closed under union. 
(ase 2: Concatenation of two CFL's is CFL. 
Let us consider the language L, generated by the grammar. 
б, -(V,UV,US, T, UT,,P,S,) 
where 
S, €V,UV, 
P, =P, UP, (S, 5, 5, } 
It is clear that the grammar G4 is context free and language generated by this 
grammar is context free (i.e.,) 
= 
Thus it is proved that CFL's are closed under concatenation. 
Case 3: CFL's are closed under star closure. 
Let us consider the language generated by the grammar С, = (V, U S, T, P, 5.) 
where 
P, 2P,U(S, 5, S,| Z) 
Hence the grammar G, is context free and the language generated by this grammar 
also content free. 
L; =L,* 
Thus it is proved that CFL's are closed under star closure. 


4.12 
CFL's are not closed under complement. 
If L is CFL, it is not true that complement of L is CFL. 


Proof 


Let us prove this theorem by contradiction Let L, and L, be CFL's, then L, and Lare 
also CFL's. 


We have already proved that CFL's are closed under union, L, U L, must be CFL. 


Since we have assumed, that CFL's are closed under complementation І, vL, must 
be CFL. 


Normal Forms for CFG 


According to de morgan's law 
So L, n L, must be CFL which is not true because CFL's are not closed under 
intersection. 

Hence it is proved that CFL's are not closed under complementation. 


4.12.3 
CFL's are not closed under Intersection. 
If L, and L, are CFL's. It is not always true that L, A L, is CFL. 
Proof 
Let us prove this therem by taking counter examples consider the two content free 
languages. 
L, z(a^b^c"|n20,m20) 
L, -(a b"c"|n20,m2z0) 
Letustake | 
L, A L, = (a^ b^ с" | n > 0) which is nota context free language. 
Hence we can prove that that CFL's are not closed under intersection. 


. What is an unit production? 

. Describe the general method of eliminating unit productions from the grammer. 
. Define CNF? 

. Define substitution? 

. Write the applications of CFG? 

. Define GNF? 

. Define useful and useless symbols in CFG? 

. What do you mean by reduction of grammer? 

. Write the steps to convert CFG to PDA. 

. What is an E-production? 


1. Identify nullable variables in the following productions and eliminate 
E - productions. 


S aA |a|B|c 
A —aB|e 

B —aA 

C —cCD 

D — abd 


CPMNANARWNHE 


н 
© 


Theory of Computation 


2. Eliminate є productions from the following grammer. 
5 — АВАС 
А —aA|e 
В —bB|e 
C >c 
3. Simplify the following grammer. 
5 —aA |a | Bb | cC 
А —aB 
B —a|4a 
C э сср 
D — ddd 
4. Eliminate unit productions from the following grammer. 
5 >АВ 
Aa 
B >C|b 
C D 
D —E|bC 
E —d|Ab 
5. Eliminate unit productions from the following grammer. 
S —A0|B 
В —4A|11 
А >01 12| В 
6. Eliminate unit productions from the following grammer. 
5 — Aa | B | Ca 
B —aB|b 
C —Db|D 
D —E|d 
E —ab 
7. Eliminate € productions from the following grammer. 
S — BAAB 
А —> 042 | 240 | є 
В >АВ|1В| 
8. State and prove pumping lemma for context free grammer? 
9. Write the general procedure to convert CIG to GNF. 
10. Convert the following СЕС to СМЕ. 
S — AaB|aaB 
Ate 
B —bbA|e 


Norma rms fc 


11. Convert the following CFG to CNF. 
5 —0A|1B 
А —›0АА|1$|1 
В >1ВВ| 05 |1 
12. Convert the following grammer into GNF 
S >АВ1 |0 
А > 004 | В 
B —|A| 
13. Convert the following grammer into GNF. 
A — BC 
В —CA|b 
C — AB|a 
14. State and prove properties of context free grammer. 
15. Obtain the PDA for the CFG given below 
S — aABB | aAA 
А —aBB|a 
В > bBB|A 
C-a 
16. Obtain the PDA for the CFG given below. 
5 — aABC 
А —aB|a 
B — bA|b 
Ca 
17. Write the steps to convert CFG to PDA. 
ROK ak 
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E | Theory of Computation 


Alan Turing introduced a new mathematical model called Turing Machine which is modified 
version of the PDA and is much more powerful than PDA. 


A PDA is not powerful enough to recognize context sensitive languages like 
(a^, b^, c": n € №, but Turing Machine is a generalized machine which can recognize all 
types of languages viz; regular languages (generaled from regular grammar) context free 
languages (generated from context free grammar), context sensitive languages (generated 
from context sensitive grammar and also the language generated from unrestricted grammar. 


It is a hypothetical machine, which can simulate any computer algorithm, no matter how 
complicated it is. A TM is a finite state machine with an infinite tape and a tape head that 
can read or write. 


Itisa finite automation with the following component. 
* Tape 
* Read write head 


* Control unit. 


ъъ 


Control 
unit 


Tape: Tape is used to store information and is divided into cells. Each cell can store only 
one symbol. The string to be scanned will be stored from the left position of the tape. The 
remaining infinity of cells each hold the blank (B), which is a special tape symbol that is not 
an input symbol. The tape is assumed to be infinite both on left and right side of the string. 


Read write head: It can read/write a symbol from where it points. i.e., it scans one cell of 
the tape at a time. Initially it is at the leftmost cell that holds the input. 


Control unit: The control unit is a finite set of states. It carries out the tasks based on 
transition table. 


In one move the depending upon the symbol scanned by the tape head and the state of the 
finite control 


* Changes state 
• Replaces the symbol pointed by the tape head by another symbol and 
e Moves its head left or right one cell tape cell and move left or right. 


| Turing mme 


ATuring Machine (TM) is a seven tuple 
М = (0,5, Г, 8, qy B,F) 
Where, Q -Set of finite states. 
X - Set of input symbols. (X is a subset of T, excluding В) 
T -Set of tape symbols 
8 - Transitions from Q x T > Q x T x {L, R} 
4, Є Qisa the start state ofM. 
B is a special symbol indicating blank character. 
F c Qisa set of final states. 


Transitions: The transition function accepts two parameters namely a state, and a tape 
symbol and returns a new state after changing the tape symbol and position of read/write 
head. 

The transition function has the form, 

8 (state, tape symbol) = (next state, tape symbol, move towards Left/Right) 


The transition 8 (q, a) = (q, X, R) means that TM is in current state д, after scanning the symbol 
a €T, TM enters into new state q, by replacing the tape symbol a by X and read/write head moves 
towards right. 

The transition diagram consists of nodes corresponding to states of Turing Machine. An 
edge from state p to state q will have a label of the form (X/Y, D) where x and y are tape 
symbols and D is the direction either `L’ or `R’ to denote ‘Left’ or ^Right' respectively. 

Here X is the scanned symbol and Y is the symbol written on to the tape. 


The graphical representation of 6 (q 0) = (q, X, R) is shown as 


(&; 0/Х, R ©] 


The graphical representation of 6(q,, 1) = à(q,, У, R) is shown as 


ING 1/Y,R @ 


The transition table for TM is a conventional tabular representation ofa transition function. 
* The rows ofthe table corresponds to the states of TM 
* The column corresponds to the tape symbols from Г, 


* Thesymbol B Indicates blank character. Usually the string ends with blank Character, 


9% а b x y B 


% (9х, К) 2 P (yy, В) B 
4, (apa, К) | (4,5,1) s (a, y, В) - 
9; è (aza L) | (q, x, R) 5 (9 В, R) 


The undefined entries in the table indicate that there are no- transitions defined i.e., dead state. 


The current configuration of TM at any given instant can be described by an instantaneous 
description (ID). It describes. 


(a) The name of the state in which the machine is presently in 
(b) The symbols on the tape and 


(c) The cell that is currently being scanned. 


An ID ofa TM isa string x q y where qis the current state, xy is the string made from tape symbols. 
The head points to the first character of the substring. 


The initial ID is denoted by д o В. Where 915 the start state and tape head points to first symbol of 
a. The finial ID is denoted by a В q B where 915 the final state and tape head points to B. 


ахун хау 
if there is a transition 5(9, х) = (q х, В) 


The language accepted Бу TM, denoted by L(M), is the set of those words in X* that causes 
the TM to enter a final state, from state q, and the tape head positioned at the left most cell. 


Let М = (0,5, Г,5, qy В, F) be a TM. 

The language L(M) accepted by M is defined as 
ЦМ) = {и | дм a, pa, where weZ*, Рє Fand a, а, Е ry 

Where q, w is the initial ID and a, P a, is the final ID. If set of all words w € Х* which causes M to 


move from start state q, to final state P and halts, then we say that the string w is accepted by 
Turing Machine. The language accepted by TM is called recursively enumerable language. 


The Turing Machine can do one of the following things. 
а. Halt and Accept by entering into final state 
b. Halt and reject. This is possible if the transitions are not defined. 


c. TM will never halt and enters into an infinite loop. There is no algorithm to determine when a 
given machine halts. 


PRosLEM 1 


Obtain a Turing Machine to accept the language L = (0", 1" / n2 1} 


—_ iz —— — 


General Procedure 

It is given that the language accepted by TM should have n number of 0's followed by n 
number of 1's. Let us take for example 00001111. 

Let q, be the start state of TM and the read - write head points to the first symbol of the 
string to be scanned. 


(NNI RC нй 


1. Replace q, the left most 0 by X and change the state to q, and then move the read - write 
head towards right, because after a zero is replaced, we have to replace a corresponding 1 
so that number of zeros matches with number of 1's. 


2. Search the left most 1 and replace it by the symbol Y and move towards left. 


3. Repeat step 1 and 2. 


Step 1: 


Step 2: 


Step 3: 


Step 4: 


In state q, replace 0 by X, change the state to q, and move pointer towards right, 
The transition can be of the form. 


5(q,0) = (q, X, R) 

The resulting configuration is 

Ee 9.9. Qa 3.1.1 
T 
4, 


In state q,, find left most 1 and replace it by Y and change the state to qy If we find 
any 0's or Y's while moving right, do not replace it with any other symbol. 


Ge) 54,0) = (a, 0, R) 
б(4„ Y) = (a, Y, R) 
$(q, 1) = (a, Y, L) 

The resulting configuration is 


€ 0.0 = SEL 1 4 
T 
4; 
The read/write head has to move towards left to obtain left most zero. In order to 


identify left most zero, identify right most X. During this process. We may find Y's 
and 0's. Don't change its value and remain in the same state qz 


5(q,Y) = (q, Y.L) 

6(4„0) = (9,, 0, L) 
The resulting configuration is 

7 9 а Y i 1? Ж 
T 

d; 


To get leftmost 0, move the pointer to right without changing the symbol x with 
other symbol. But change the sate to 4 


Sla» X) = (ay X, К) 


The current configuration will be 


£,.0 0 0 Y 1 1 i 


p5: Repeat step 1 to step 4 to get the configuration shown below 
X X X X Y Y. Y" 
T 


do 


ep6: In the state q, if the scanned symbol is Y, it means there are no more O's. To check 
there are no more I's move the pointer towards right by changing the state to q, 


(ay Y) = (ay Y. R) 
Мер 7: In state q,, we should see there are only Y's and no more 15. 
5(4» Y) = (q, Y, R) 
Repeatedly applying this transition, the following configuration is obtained. 
X X X X Y Y Y X B 
$ 
d; 
йер 8: Since the string ends with infinite number of blanks, change the state to q, which 
is a final state. 
8(q, B) = (a, B, №) 
^. The Turing Machine to accept the language L = {а" b" |n > 1} is defined by 
М = (0, Х, Г, 5, qy В, Е) 


Where 
Q = (4,4450, 4) 
X ={0,1} 
T8401, X; Y Bj 


q, Е Qis the start state of machine 
B ЕГ isthe blank symbol. 
Е = {q,} is the final state 
6: is shown below 

Slay 0) = (q, X, R) 

$(q,0) = (а, 0, R) 

Sla, Y) = Ч, Y, R) 

lay 1) = (9, Y, L) 

5(4»У) = Gy Y, L) 

5(а» 0) = (а» 0, L) 

(a, X) = (ay X, R) 

lay Y) = (a, Y, R) 

la, Y) = (a, Y, R) 

lay В) = (4, В, К) 


The transitions can also be represented by transition table. 


[5 
pA 0 b x | y B 
% (q, X, R) = = (aq, Y, R) - 
a, | (q,0,R) | (a, EL) Б (q, Y R) E 
4, |(q,0,L) = (9, X. R) | (92, Y, L) 5 
d, Ы RS ы (q, YR) | (q, B, В) 
СА - B = 


Turing Machine can also be represented by transition diagram. 


Y/Y,R Y/YL 
0/0,R 0/0, L 


0/XR B 1/YL 


X/XR 


|| To accept the string 


The sequence of moves made by the TM to check whether the string 0011 is accepted or not 
is. 


40011 1— Xq011 F- X0q11 К Xgjüyi 


(initial ID) 
e q,X0Y1 = Xq0Y1 — XXq,Y1 
— XXYq1 = XXq,YY = Xq,XYY 
= XXqYY + XXYq,Y — XXYYq, 
= XXYYBq, 


(Final ID) 
Since the final state q, is reached, the string 0011 is accepted. 


PRosLEM 2 


Show that L = {а? | P is a prime} is not context - free language. 


We use the following property of L. If w € L, then [м | is a prime. 


Step 1: Suppose L = L(G) is context - free. Let n be the natural number obtained by usingthe 
pumping lemma. 
Step 2: Let P bea prime number greater than n. Then z = a^ € L, we write z = uv wxy. 
Step 3: By pumping lemma, и у? wx? y =u МУЕГ. 
So | u wy | is a prime number. say q. 
Let | vx | = г. Then | ии wx y | =q + qr. 


As q + q' is not a prime, u v w x* y € L. This is a contradiction. Therefore L is not 
context free, 


CFL's are closed under union, concatenation and star. 


4.12.1 


IfL, and L, are CFL's, then L, UL, L, . L, and L,* also denote the CFL. 
Proof 


Let L, and L, be two CFL's generated by the CFG's 
G, =(У,Т,Р,, S,) and 
G, =(V,,T,, P, 5,) respectively. 
Assume that V, and V, are disjoint. 
Case 1: Union of two CFL's is CFL. Let us consider the language L, generated by the 


grammar. 
G, = (V, U V, U S, T, UT, P, S.) where 
S, =5, 15, 


P, =P, УР, U{S, >S, | S,} 
It is clear that grammar G, is context free and the language generated by this 
grammar is also context free. 
It is easy to prove that L, = L, U L, 
if we assume w E L, then the possible derivation of w from $, 15 
S, >S, sw 
if we assume w € L, then the possible derivation of w from S, is 
5, >S, Ъ и 


So if w € L, one of the derivation 

S, >S, or S, > S, is possible. 
In the first case, all the variablesi in V, and all the terminals in T, may be used to get 
the derivation. 

S, № w which uses only the production in P, 
In the second case, all variables in V, and all the аах in T, may be used to get 
the derivation S, 55 w which uses only the production in Р,. 
(е) L, =L,UL,. 
Thus it is proved that CFL's are closed under union. 
Case 2: Concatenation of two CFL's is CFL. 
Let us consider the language L, generated by the grammar. 

‚ =(V,UV,US,T,UT,,P,S,) 


where 

5, €V, UV, 

=P, UP, U {5, >S, 5,} 

It is A that the grammar G4 is context free and language generated by this 
grammar is context free (i.e.,) 

L, =L,L, 
Thus it is proved that CFL's are closed under concatenation. 
Case 3: CFL's are closed under star closure. 
Let us consider the language generated by the grammar G, = (V, US, Tp P, S,) 
where 

P, >P, U {S, >S, S, |£} 
Hence the grammar G, is context free and the language generated by this grammar 
also content free. 

LsLA 
Thus it is proved that CFL's are closed under star closure. 


4.12.2 

CFL's are not closed under complement. 

If L is CFL, it is not true that complement of L is CFL. 
Proof 


| Let us prove this theorem by contradiction Let L, and L, be CFL's, then L, and Lare 
also CFL's. 


We have already proved that CFL's are closed under union, L, U L, must be CFL. 


Since we have assumed, that CFL's are closed under complementation L, UL, must 
be CFL. 


According to de morgan's law 
TUL, «tnt, 
So L, n L, must be CFL which is not true because CFL's are not closed under 
intersection. 
Hence it is proved that CFL's are not closed under complementation. 


CFL's are not closed under Intersection. 
If L, and L, are CFL's. It is not always true that L, N L, is CFL. 
Proof 
Let us prove this therem by taking counter examples consider the two content free 
languages. 
L, = {a"b"c™|n20,m20} 
L, = {a" Б" с" |n20,m20} 
Let us take 
L, N L, = (a^ b^ c" | n= 0} which is nota context free language. 
Hence we can prove that that CFL's are not closed under intersection. 


- What is an unit production? 

- Describe the general method of eliminating unit productions from the grammer. 
. Define CNF? 

- Define substitution? 

- Write the applications of CFG? 

. Define GNF? 

- Define useful and useless symbols in CFG? 

- What do you mean by reduction of grammer? 

- Write the steps to convert CFG to PDA. 

- What is an E-production? 


1. Identify nullable variables in the following productions and eliminate 
E - productions. 
S эад|а|В|с 
А —aB|e 
B —aA 
C —cCD 
D — abd 
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2. Eliminate е productions from the following grammer. 
S — ABAC 
А —aA|e 
В В| є 
С —c 
3. Simplify the following grammer. 
5 >аА|а| Bb | сс 
А —aB 
В >а| Аа 
С —cCD 
р > ddd 
4. Eliminate unit productions from the following grammer. 
S >АВ 
А эа 
В >C|b 
cC >D 
D —E|bC 
E —d|Ab 
5. Eliminate unit productions from the following grammer. 
S —A0|B 
В >А| 11 
А —0|12|B 
6. Eliminate unit productions from the following grammer. 
S — Aa |В | Са 
В —aB|b 
C —Db|D 
D —E|d 
E —ab 
7. Eliminate € productions from the following grammer. 
S — BAAB 
А —0A42|2A40| € 
В >АВ|1В| 
8. State and prove pumping lemma for context free grammer? 
9. Write the general procedure to convert CIG to GNF. 
10. Convert the following СЕС to СМЕ. 
S — АаВ|ааВ 
А >Е 
В >ЬБА | є 


Normal Forms for CI 


A1. 


13. 
14. 
15. 


16. 


17. 


Convert the following CFG to CNF. 
S —0A|1B 
А ОАА |15|1 
В >1ВВ| 05 |1 


. Convert the following grammer into GNF 


S >АВ1 |0 
А > 004 | В 
В Э |А| 
Convert the following grammer into GNF. 
A — BC 
B —CA|b 
C — AB|a 
State and prove properties of context free grammer. 
Obtain the PDA for the CFG given below 
S — aABB | aAA 
A —aBB|a 
B — bBB|A 
Ca 
Obtain the PDA for the CFG given below 
5 — aABC 
А —aB|a 
B > bA|b 
Ca 
Write the steps to convert CFG to PDA. 
LES £4] 
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Alan Turing introduced a new mathematical model called Turing Machine which is modified 
version of the PDA and is much more powerful than PDA. 

A PDA is not powerful enough to recognize context sensitive languages like 
{a", b", с": n € N}, but Turing Machine is a generalized machine which can recognize all 
types of languages viz; regular languages (generaled from regular grammar) context free 
languages (generated from context free grammar), context sensitive languages (generated 
from context sensitive grammar and also the language generated from unrestricted grammar, 
It is a hypothetical machine, which can simulate any computer algorithm, no matter how 
complicated it is. A TM is a finite state machine with an infinite tape and a tape head that 
can read or write. 


It is a finite automation with the following component. 
* Tape 
* Read write head 


* Control unit. 


fo 


Control 
unit 1 


Tape: Таре is used to store information and is divided into cells. Each cell can store only 
one symbol. The string to be scanned will be stored from the left position of the tape. The 
remaining infinity of cells each hold the blank (B), which is a special tape symbol that is not 
an input symbol. The tape is assumed to be infinite both on left and right side of the string. 


Read write head: It can read/write a symbol from where it points. i.e., it scans one cell of 
the tape at a time. Initially it is at the leftmost cell that holds the input. 


Control unit: The control unit is a finite set of states. It carries out the tasks based on 
transition table. 


In one move the depending upon the symbol scanned by the tape head and the state of the 
finite control 


* Changes state 
* Replaces the symbol pointed by the tape head by another symbol and 
* Moves its head left or right one cell tape cell and move left or right. 


ATuring Machine (TM) is a seven tuple 


М =(Q5,0,8,q,B,F) 
Where, Q -Set of finite states. 
У -Setofinput symbols. (X is a subset of T, excluding B) 
T -Setoftape symbols 
6 -Transitions from Q x Г — Q xT x {L, R} 
4, €Qisa the start state of M. 


Bisa special symbol indicating blank character. 


Е c Qisaset of final states. 


Transitions: The transition function accepts two parameters namely a state, and a tape 
symbol and returns a new state after changing the tape symbol and position of read/write 
head. 

The transition function has the form, 

5 (state, tape symbol) = (next state, tape symbol, move towards Left/Right) 


The transition 8 (q, a) = (q, X, R) means that TM is in current state q, after scanning the symbol 
a € Г, TM enters into new state q,, by replacing the tape symbol a by X and read/write head moves 
towards right. 

The transition diagram consists of nodes corresponding to states of Turing Machine. An 
edge from state p to state q will have a label of the form (X/Y, D) where x and y are tape 
symbols and D is the direction either `L or `В’ to denote ‘Left’ or ‘Right’ respectively. 

Here X is the scanned symbol and Y is the symbol written on to the tape. 


The graphical representation of 8 (q, 0) = (q, X, К) is shown as 


022—9 | 


The graphical representation of 5(q,, 1) = 5(q., У, R) is shown as 


E] 


The transition table for TM is a conventional tabular representation of a transition function, 
* The rows of the table corresponds to the states of TM 


* The column corresponds to the tape symbols from T. 


+ Thesymbol В Indicates blank character. Usually the string ends with blank Character, 


94 a b $ y B 
9, (9, х, В) Cen m ҮН (q, y, В) е 
а, (9,9, В) | (aq, y, L) è (zy, R) * 
9 | (aza L) | (qj X R) > (az B, В) 


The undefined entries in the table indicate that there are no- transitions defined ie, dead state. 


The current configuration of TM at any given instant can be described by an instantaneous 
description (ID). It describes. 


(a) The name of the state in which the machine is presently in 
(b) The symbols on the tape and 
(c) The cell that is currently being scanned. 


An ID ofa TM is a string x q y where q is the current state, xy is the string made from tape symbols. 
The head points to the first character of the substring. 


The initial ID is denoted by q a В. Where q is the start state and tape head points to first symbol of 
а. The finial ID is denoted by a B q B where q is the final state and tape head points to B. 


Example : 


qxyP-xqy 
if there is a transition ó(q, x) = (q, x, R) 


The language accepted by TM, denoted by L(M), is the set of those words in Х* that causes 
the TM to enter a final state, from state q, and the tape head positioned at the left most cell. 


M = (0,5, T, 8, qy B, F) bea TM. 
ie language L(M) accepted by M is defined as 
М) = {м | q,wH- a, p a, where weZ*, PeFanda, a, ЕГ}* 

Where q, w is the initial ID and a, Ра, is the final ID. If set of all words w € Z* which causes M to 


move from start state q, to final state P and halts, then we say that the string w is accepted by 
Turing Machine. The language accepted by TM is called recursively enumerable language. 


The Turing Machine can do one of the following things. 
а. Halt and Accept by entering into final state 
b. Halt and reject. This is possible if the transitions are not defined. 


c, TM will never halt and enters into an infinite loop. There is no algorithm to determine when а 
given machine halts. 


Obtain a Turing Machine to accept the language L = (0", 1^/n2 1} 


— — q —— — 


General Procedure 

It is given that the language accepted by TM should have n number of 0's followed by n 
number of 1's. Let us take for example 00001111. 

Let q, be the start state of TM and the read - write head points to the first symbol of the 
string to be scanned. 


Д Она lapi, ib 


1. Replace q, the left most 0 by X and change the state to 4, and then move the read - write 
head towards right, because after a zero is replaced, we have to replace a corresponding 1 
so that number of zeros matches with number of 1's. 


2. Search the left most 1 and replace it by the symbol Y and move towards left. 


3. Repeat step 1 and 2. 


Step 1: In state q,, replace 0 by X, change the state to д, and move pointer towards right. 
The transition can be of the form. 


б (ay 0) = (a, X, К) 
The resulting configuration is 
X 0. 09 Ook 1 1.5 
T 
d; 


Step2: In state q, find left most 1 and replace it by Y and change the state to q,. If we find 
апу 0’s or Y's while moving right, do not replace it with any other symbol. 


(ie) 5(q,, 0) = (q, 0, R) 
54, Y) = (а, Y, R) 
5(q, 1) = (a, Y, L) 
The resulting configuration is 
х 9 0 Q0 Y X ted 


4; 
Step 3: The read/write head has to move towards left to obtain left most zero. In order to 
identify left most zero, identify right most X. During this process. We may find Y's 
and 0's, Don't change its value and remain in the same state q,. 


5 (aq, Y) = (a, Y, L) 

5 (q,,0) = (q, 0, L) 
The resulting configuration is 

х 0 Ore Y 17-2 3 
T 


4; 
Step 4: To get leftmost 0, move the pointer to right without changing the symbol x with 
other symbol. But change the sate to q,. 


Slay X) = (y X, R) 
The current configuration will be 
и.о чу уу X 1 


р5: Repeat step 1 to step 4 to get the configuration shown below 


X X xXx X Y Y Y"Y 
T 


4 
Мер 6: In the state q,, if the scanned symbol is Y, it means there are no more O's. To check 
there are no more I's move the pointer towards right by changing the state to q, 
б(4, Y) = (9 Y, R) 
Мер 7: In state q,, we should see there are only Y's and no more I's. 
5(а, Y) = (qy Y, R) 
Repeatedly applying this transition, the following configuration is obtained. 
Sp X UXGE. YoYo X X B 
T 
qs 
Step 8: Since the string ends with infinite number of blanks, change the state to q, which 
is a final state. 
8(q, B) = (qy B, R) 
. The Turing Machine to accept the language L - (a^ b" [n 2 1) is defined by 
М = (0,5,Г, 8, qy B, F) 
Where 
Q = (ay Ч» 4» 4, Uh 
X ={0, 1} 
Г ={0,1,X, Y, B) 
q, Є 915 the start state of machine 
B ЕГ isthe blank symbol. 
Е = {q,} is the final state 
8: is shown below 
5(q, 0) = (q, X, В) 
54,0) = (0,0, R) 
8(q, Y) = (9, Y, К) 
5(q, 1) = (9, Y, L) 
8(q, y) = (9, Y, L) 
5(2, 0) = (ax 0, L) 
(aq, X) = (ay X R) 
lay Y) = (93 Y, R) 
5(а, Y) = (a, Y, R) 
5(q, В) = (qy В, R) 


^ TOR — 


The transitions can also be represented by transition table. 


5 

9/ 

УГ 0 b X Y B 

% | (qj X R) + - (а, Y, R) 

4, | (9,0, К) | (а, YL) - (q, УК) - 

4, (9,0,1) - (dy X R) | (92, Y, L) 

СА =" s (q, Y, R) | (q, B, R) 
IA 3 Р 


Turing Machine can also be represented by transition diagram. 


W To accept the string 


The sequence of moves made by the TM to check whether the string 0011 is accepted or not 
is. 


40011 f Xq011 = X0q11 = Xq0Yi 


(initial ID) 
C q,X0Y1 — Xq0Y1 = XXq,Y1 
Ce XXYq1 — XXq,YY FB Xq,XYY 
C XXqYY F XXYqY к XXYYq, 
— XXYYBq, 


(Final ID) 
Since the final state q, is reached, the string 0011 is accepted. 


Turing Machine 


PnosLEM 2 


onstruct a Turing Machine to accept the language 
ЦМ) = {0" 1" 2" |п2 1} 

itis given that the language accepted by TM should have n number of 0's followed by n 

humber of 1's followed by n number of 2's 

let q, be the start state of TM and the read write head points to the first symbol of the string 

iy be scanned. 


jixample : 


d, 
Replace the left most 0 by X, 1 by Y and 2 by Z so that the number of 0's matches with 


|number of 1's and 2's _ 
| General Procedure 


Step 1: In state д, replace 0 by X and change the state to q,, move the pointer towards 
right. The transition can be of the form. 


Slay 0) = (a, X. R) 
The current configuration is 
x .0 Өз аз 4 а> 4 
T 


4, 
‘Step 2: In the state q, find leftmost 1 and replace it by Y and change the state to q,- Move 
the pointer towards right. 


5(4,,0) = (a, O, R) 
Slay Y) = (9, Y R) 
la, 1) = (а, Y. R) 
And the configuration will be, 
x 000 Y1:112222 
T 
d; 


“Step 3: In state q, find left most 2 and replace it with Z by changing the state to 4; and 
pointer towards left. When we are searching for the symbol 2, if we encounter 1 


Step 4: 


Step 5: 


Step 6: 


Step 7: 


Step 8: 


or Z, don't change the symbol and remain in state q,. 
$(q, 1) = (q, 1, R) 


$(q,Z) = (q, Z, R) 
б(4„ 2) = (ay Z, L) 


Search for the rightmost X to get leftmost O. During this process, if the symbols 
such as Z's, 15, Y's, 0's are scanned, do not change the symbol and state but simply 
move the pointer to the left. 


ôlay Z) = (q, Z, L) 
Slay 1) = (9,1,1) 
5(q, Y) = (а, Y, L) 
5(q, 0) = (q, 0, L) 


On encountering X, change the state to q, and move the pointer towards rightto 
get leftmost 0. 


5(а,Х) = (qy X, R) 
The configuration will be, 


xO m. YT LT 2 z2222 


d, 
Repeat step 1 to step 4 till the following configuration is obtained 
X X X ЭЕ Б vy om cue 
T 
4, 


In the state q, if the scanned symbol is Y, it means there are по more 0's . to check 
there are no more 1's move the pointer towards right by changing the state as 4 


Slay Y) = (ay Y, R) 


In state q,, we should see there are only Y's and no more 1's by moving the pointer 
towards right as long as the scanned symbol is Y. 


5(q, Y) = (а, Y, R) 
The current configuration will be 


X. XX X Yo Y Y Y zz 2 ZU 


d, 


In state q, if we encounter 7, it means there are no 15 on scanning the first 7, 
change the state to q.. 


(a, Z) = (a, Z, В) 


йер 9: In state q,, we should see there are only Z's and no more 2's by moving the pointer 


towards right as long as the scanned symbol is Z 


5(q, Z) = (4,2, R) 


The Current configuration will be 


xXx X Y v Y Y 2-2 


Step 10: Since the string ends with infinite number of blanks, change the state to q, which 


is a final state. 
5(q, B) = (q В, R) 


Z 2 


. The Turing Machine to accept the language 
L = {0" 1" 2" | n> 1} is defined by 
M -(Q,Z 5,4, B, F) 


Where 


Q = {ay d, 4» Ч» 0,45 4) 


X -(0,1) 


Г = {0, 1, 2, Х, Y, Z, В} 
4, Е Qis the start state of machine 


В €T is the blank symbol. 


F = {q,} is the final state. 
8 is shown below using transition table 


T 
d; 


5 гү 
% 0 1 2 x Y Z B 
Sa XR] - Е q,YR| - 
q, | (aOR) | (qY, R) а, +В) | __- 
СА г (9,1,6) | (9,2,1) i (a, 2, R) š 
а, | (q4 0L) | (4, 1, D) а (dy XR) | (ay YD) | (qy Z L) # 
Га, š (qy Y, В) | (a, Z, R) = 
ШЕ? Я . - * (d; Z, | (qo В, R) 


inr 
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The transition diagram 


Y/YR 7/7,К 0/0,L 
0/0,R 


171,8 
o/XR „СА ув a 2/2 


Obtain a TM to accept a string w of a's and b's such that М, (и) is equal to N,(w) is 


equal to №, (и). 


It is given that the language accepted by TM can have a's and b's at any positions provided 
number of a's should be equal to number of b's. For example abbaba. 


General Procedure 


Let q, be the start state and the read write head points to the first symbol of the string to be 
scanned. The general procedure to design a TM will result in three cases depending on the 
input symbol to be scanned on the state q, 


1. On encountering a 2. On encountering b 3. On encountering B 
Case 1: Оп encountering a 
In state q, if we encounter a replace it by X. Then skip all subsequent symbols till 


we read b and replace b by У. Now repeat any one of the three cases based on the 
next symbol to be scanned. 


Consider the situation 


X X a Y a Y b b B 
T 


d, 


Turing Machine ваз. 


Step 1: 


Step 2: 


| Step 3: 


Step 4: 


In state q,, on reading a, change the state to q,, replace a by X and move the pointer 
towards right. The resulting transition is 


ô (ay a) = (а, X, R) 
The resulting configuration is shown below 
X X X Y a Y b b B 
T 
d; 
In state q,, move the pointer towards right in search of b and replace it with Y. The 
transitions are. 


5 (аа) = (q, a, R) 
8 (a, Y) = Ч, Y, R) 
8 (ax b) = (a, Y. L) 
The resulting configuration is shown below 
X X X Y 4 Y ¥ b B 
T 
4; 
In state q,, move the pointer towards left. On encountering X, change the state to 4, 
$(q, Y) = (9, Y, L) 
б6(4„а) = (q, a, L) 
8(q, X) = (qy X, R) 
The resulting configuration is 
X X X Y @ * Y b B 
T 
9, 


In the state q,, on reading Y indicates so far the number of a's is equal to number of 
b's so move the pointer towards right. 


Slay Y) = (q Y, R) 
The resulting configuration is 
X. X X Y a Y Y b B 
T 
do 
Repeat one of the three case. 


Case 2: One encounters b in state q, if we find b replace it with X. Then skip all subsequett 
symbols till we read a and replace a by Y. Now repeat any one of the three cases 
based on the next symbol to be scanned. 


Consider the situation 


X X b Y ba a B 


d, 


Step1: In state q, on reading b, change the state to q,, replace b by X and move the pointer 
towards rights to get left most a. 


Slay b) = (q4 X, В) 
The resulting configuration is 
E X XY иван 
1 
d; 
Step2: In state q,, move the pointer towards right to find a and replace it with Y. 
5(q,,b) = (q; b, R) 
5(a, Y) = (a, Y, R) 
Sla, a) = (a Y,L) 
The resulting configuration is 
X X Жу Yo Y a. B 
T 
а, 


Step3: In state q, move the pointer towards left on encountering X, change the state to 4 
and move the pointer towards right. 


5(q, Y) = (a, Y, L) 
5(q, b) = (qy b, L) 
Slay X) = (9, X, R) 
The resulting configuration is 
X X X Y bv" Y Y a B 
T 
9, 


“йер 4: 


(ase 3: 


ng Machi 


In state q, on reading Y indicates so far the number of a's are equal to number of 
b's so move the pointer towards right. 


Slao Y) = (4, Y, R) 
The resulting configuration is 
X X Y b Y "y a В 
T 
do 
Repeat one of the three cases 


One encounters В in state q, if we encounter B, move the pointer towards right and 
change the state to q, which is the final state. 


Slay B) = (9, B, R) 
So, the TM to accept strings of a's and b's such that number of a's is equal to number 
of b's is defined as 


М = (0,Х, Г, 5,4, В, Е) 


where, 
X = (a, b) 
Г = (a, b, X, Y, B) 
9015 the start state 
Bisthe Blank character 
F = (q) 
6 = 15 shown below using the transition table 
5 i К | шй 
Q 
4 а b X Y B 
>h | WR | qy X, R M WYR | q;BR 
4 | WOR | q, XL „ҮК 
4, | d, SL qyXR| q,YL 
4, | d, YL | g,bR| - Gy YR 
а, ~- | ay bh | 9% К] ay Wh 
* 
t4 = - LL as 


There are a number of other types of turing machines in addition to the one which are have 
already seen, such as turing machines with multiple tapes, turing machine having one tape 
but with multiple heads, turing machine with two dimensional tapes, non deterministic 
turing machines etc. All these turing machines are equally powerful. That is, what one type 
of turing machine computes any other can also compute the same. However, the efficiency 
of computation, that is, how fast they can compute may vary. 


1. Multi tape TM 


Multi tape Turing machines have multiple tapes where each tape is accented with a 
separate head. It consists of a finite control with K - tape heads and K - tapes. Each 
tape is infinite in both directions. Each head can move independently of the other 
heads. Initially the input is on tapel and others are blank. At first the first tape is 
occupied by the input and the other tapes are kept blank. Next, the machine reads 
consecutive symbols under its heads and the TM prints a symbol on each tape and 
moves its heads. On a single move depending upon the state of the finite control and 
the symbol scanned by each of the tape heads the machine can 

* Change the state 

* Printa new symbol on each of the cells scanned by its tape heads. 

* Move each of its tape heads independently one cell to the left of right. 


The language accepted by a one-way infinite tape TM is also accepted by a multi tape 
TM. 


2. Non deterministic TM 


А non deterministic TM is a generalization of the standard TM for which every 
configuration may yield none, or one or more than one next configurations. 
In contrast to the deterministic turing machines, for which a computation is a 
sequence of configurations, і.е., a computation of a non deterministic TM is a tree 
of configurations that can be reached from the start configuration. For a given state 
and the tape symbol scanned by the tape head, the machine has a finite number of 
choices for the next move. Each choice consists of a new state, a tape symbol to print 
anda direction of head motion. If the input is accepted at least by one path among all 
the different possible paths, then the input is accepted by the TM. 


3. Multi - dimensional TM 


Multi - dimensional TM has a finite control, a tape which consists of K-dimensional 
array of cells which is infinite in all 2K directions. 


Depending on the states and the symbol scanned, the device changes state, prints а 
new symbol, moves its head to one ofthe 2K directions either positively or negatively. 
Initially the input is along one axis and the head is at the left end of the input. 
4. Multi head TM 

Amulti head TM isa single tape TM with multiple read-write heads. However in every 
state only one head may be used. The heads are numbered from 1 to K. Therefore for 
К heads we have a partition of states Q,, Q, ........ Q, where each Q, contains the set 
of states which use the i'^ head. A move of the TM depends on the state and on the 
symbol scanned by each of the head. In one move the heads may move independently 
to the left or to the right. 


For К = 3, we might have something like this. 


A machine may accept a language or it may not accept (reject) a language. So the output of 
the machine may be accept or reject. This problem is called membership problem. 


"Given a machine, M and a string x, does M accept x?” the output will be yes/no. Given a language, 
the machine may have to identify whether the language is finite or infinite. АП such problems with 
two answers yes/no, accept/ reject, finite/infinite are called decision problems. 


According to Church - Turing thesis, an appropriate way to formulate the idea ofa decision algorithm 
precisely is to use a Turing Machine. For some decision problems we can write the algorithm for 
any specific instance, (which indicates that the problem can be solved using turing machine) but 
it is not possible to write a general decision algorithm that works for any given instance, which 
indicates that a turing machine does not exist to solve a decision problem, 
That is there are problems that are solvable by TM and that are not solvable by TM, which can be 
divided into two groups, as 
* The problems for which the solution exists in the form of algorithms. i.e., if there is an 
algorithm to solve a problem, there exists a TM that halts and results whether the input is 
accepted or rejected. 


* The problems that run forever i.e., a TM will not halt on inputs that they do not accept. 


The decision problems that have decision algorithms with output yes/no are called solvable 
problems. According to Church-Turing thesis, an appropriate way to formulate precisely the 
idea of a decision algorithm is to use a Turing machine. 

Recursive and recursively enumerable are the languages associated with turing machines. 
The language accepted by a turning machine, M is recursively enumerable if and only if 
L = ЦМ). ie. if L is a language, there exists а turning machine that will halt and accept an 
input string in L and may either halt and reject or loop forever. 


Turing, Machine 


language, L is recursive if = L(M) for some Turing machine, M such that 
* If wis іп L, then M accepts. 


* If wis not in L, then M eventually halts and never enters an accepting state. 


TM for a Recursive language. 
Alanguage, L is said to be recursive enumerable if there exists a turning machine that accepts it. 


TM for a Recursively enumerable language. 


Ле, L is recursively enumerable if L = L (M) for some turing machine, М. It doesn't say anything 
‘about w that is not in L, In other words if L is a language, there exists a turing machine that will halt 
| and accept an input string in L or halt and reject otherwise. 
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Every recursive language is also recursively enumerable. But it is not clear if every recursively 
enumerable language is also recursive. 

Any instance of a problem for which the turing machine halts whether the input is accepted or 
rejected is called solvable or decidable problem. There are so many problems that are solvable, But 
‘there are some problems that are not solvable, 

|| A problem whose language is recursive is said to be deicidable, else undecidable. 

The problems that run forever on turing machine are not solvable. In other words, there are some 
problem input instances for which turing machines will not halt on inputs that they do not accept. 
Those problems are called unsolvable or undecidable problems. In general, if there is no general 
algorithm capable of solving every instance of the problem, then the decision problem is unsolvable, 
| | That is, a problem is undecidable if there is no algorithm that takes as input, an instance of the 
problem and determines whether the answer to that instance is yes or no. 


The theorems which we are going to solve is proved by reducing one problem to апо 
These reductions involve combining several turing machines to form a composite machine 
The state of the composite turing machine has a component for each individual compone 
machine. Similarly the composite machine has separate tapes for each individual machine 
When an algorithm is given, the composite turing machine performs one action if the 
algorithm accepts and another if it does not accept, we could not do this if we were giver 
an arbitrary turing machine rather than an algorithm. Since if the turing machine did not 
accept, it might run forever, and the composite machine would never initiate the next task 
In the pictures of the proofs, an arrow into a box labeled. "Start" indicates a start signal 
Boxes with no "Start" signal are assumed to begin operating when the composite machine 
does. Algorithms have two outputs, "Accept" [Yes] and "Reject" [No] which can be used a 
start signals or as a response by the composite machine. Arbirary turing machines have only 
an "Accept" output, which can be used for the same purposes. 


Recursive language are closed under the following operations. If L, L, and L, are recursive 
languages, then 

* The Kleene closure L* of L is recursive 

* The concatenation of L, . L, is recursive 

* The union L, U L, is recursive 

* The intersection L, n L, is recursive 

* The complement L! = Y* - Lis also recursive 


B Theorems 

If L is a recursive language then its complement [Л is also recursive 
[ог] 

The complement of a recursive language is recursive. 

Proof 


Let L be a recursive language and M a turing machine that halts on all inputs and 
accepts L. Construct М! from M so that if M enters a final state on input w, 


then М! halts without accepting. If M halts without accepting, М' enters a final state, 


Since one of these two events occurs, М! is an algorithm. Clearly L (M!) is the 
complement of L and thus complement of L is a recursive language. 


|» Accept 
m> Reject 


construction of M" from M. 


The union of two recursive languages is recursive. 
OR 
ihe union of two recursively enumerable languages is recursively enumerable. 


Proof 
Let L, and L, be recursive languages accepted by algorithms M, and M, we construct M, 
which first simulates M,. If M, accepts, then M accepts. If M, rejects, then M simulates 
M, and accepts if and only if M, accepts. Since both M, and M, are algorithms, M is 
guranteed to halt. Clearly M accepts L, U L,. 


accept 


Mhea 


> accept 


Construction for union of recursive language. 


For recursively enumerable languages the above construction does not work, since M, 
may not halt. Instead M can simultaneously simulate M, and M, on separate tapes. If either 
accepts, then M accepts. 


| Construction of М! for recursively enumerable languages. 

If a language L and its complement L' are both recursively enumerable, then L (and hence L') 

is recursive. 

Proof 
Let M, and M, accept L and L* respectively. Construct M by simulataneously simulating 
M, and M,. M accepts w if M, accepts w and rejects м if M2 accepts и. Since w is in 
either L or L,, we know that exactly one of M, or M, will accept. Thus M will always 
say either "accept" or "reject", but will never say both. Note that there is no priori 


limit on how long it may take before M, or M, accepts, but it is certain that one or the 
other will do so. Since M is an algorithm that accepts L, it follows that L is recursive. 


—> accept 
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recursively enumerable. Halting problem is an important problem which is not recursively 
enumerable that is unsolvable/undecidable decision problem. 

The halting problem can informally be started as "given a turing machine M and an input 
string w with the initial configuration qy after some (or all) computations do the machine M 
halts?" In other words we have to identify whether (M, w) where M is the turning machine, 
halts or does not halt when w is applied as the input. The domain of this problem is to be 
taken as the set of all turing machines and all w. i.e., given the description of an arbitrary 
turing machine M and the input string w, we are looking for a single turing machine that 
will predict whether or not the computations of M applied to w will halt. When we state 
decidability or undecidability results, we must always know what the domain is, because 
this may affect the conculsion. The problems may be decidable on some domain but not on 
another. 

It is not possible to find the answer for halting problem by simulating the action of M on w 
by a universal turing machine, because there is no limit on the length of the computation. If 
M enters into an infinite loop, then no matter how long we wait, we can never be sure that 
M is in fact in a loop. The machine may be in a loop because of a very long computation. 
What is required is an algorithm that can determine the correct answer for any M and w by 
performing some analysis on the machines description and the input. 


Given an arbitrary turing machine M - (Q, E, qy B, A) and the input 
w € Х*, does M halt on input w? 


yp w, > Machine 
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© The turing machine, M which halts on input w is undecidable. 


Proof 
We assume that the turing machine which halts [HALT,,,] is decidable and get a 
contradiction. 
Let M, be the turing machine such that T(M,) = HALT,,, and let M, halt eventually on 
all (M, w). 


We construct a turing machine, M, as follows. 
Step 1: For M, (М, w) is an input. 
Step 2: TM M, acts on (M, w). 
Step 3: If M, rejects (M, w) then M, rejects (M, w). 
| Step 4: If M, accepts (М, w) simulate the ТМ M on the input string w until M halts. 
_ Step 5: If M has accepted w, M2 accepts (М, w) otherwise M2 rejects (М, w). 
| Instep 4 when M, accepts (M, w) the turing machine M halts on w. In this case either 
| an accepting state q or a state д such that 6 (q', а) is undefined till some symbol а 
in wis reached. In the first case M, accepts (M, w) and in the second case M, rejects 
(M, w). 
It follows from the definition of M, that M, halts eventually. 
Also T(M2) = (M, w)/The TM accepts w}. 
= Any 


This is a contradiction since A,,, is undecidable. 


The post correspondence problem was first introduced by Emil post in 1946. Later, the 
problem was found to have many applications in the theory of formal languages. The 
problem over an alphabet X belongs to a class of yes/no (accept/reject] problems and is 
stated as follows: 
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we say that there exists a post correspondence solution for pair (A, B) if there is a non empty 
sequence of integers i, j, such that 

W, = Vp Vp Vy 
The post correspondence problem is to device an algorithm that will tell us, for any (A, B) whether 
or not there exists a solution. If there exists a solution to PCP, there exist infinitely many solutions. 


Theory of Computation 


Example : 


Let Y = (0,1) 
А z(w,w,w) 
Where w, 211, w, = 100, w, = 111 
and В = {v vy v} 
where v, =111, v, = 001, v, = 11. 


1 
For the pair (A, B) there is PCP solution as shown below. 


w, w, LZ 


DN RA 
lili 


Vi V, V, 


1 2 3 


If we take, 
w, = 00, w, 001, w, = 1000 
у, 70, v, 211v, = 011 
there cannot be any post correspondence solutions because any string composed of elements of A 
will be longer then the corresponding string from B. 


Does the PCP with two lists A = (b, bab’, ba) and B = (D?, ba, ba) have a solution. 


For the pair (A, B) there is a solution as shown below. 


1. Write the closure properties of recursive language. 
2. Define post correspondence problem. 


1. Define TM, Language acceptance of TM and ID of TM 
2. Define Recursive and Recursively enumerable languages 


3. Explain halting problem of TM 
вж" 


MODEL QUESTION PAPERS 


MODEL QUESTION PAPER 1 


VI Semester BCA Degree Examination 
(CBCS) (16-17 and onwards) 
Computer Science 


BCA 601T : Theory of Computation 


Time 3 Hrs. Max. Marks : 100 


Answer any ten questions. Each carries two marks 10x2-20 


1. 


‚ List the algebraic laws governing regular expression. 
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10. 
11. 
12. 


Define e - NFA 


. Define nullable variables 

. Define CFG 

. Define Parse tree 

. List the properties of regular languages 

‚ Obtain a grammar to generate the set of all strings with exactly one a, over X = (a, b) 
„ What are the ways to find the acceptance of a language by PDA 

. Find the language accepted by the following grammar. 


5 — aas|aa 
Define GNF 
State the Halting problem of TM 
State any two application of CFG. 


оп В 


Answer any five questions. Each carries 5 marks 5х5=25 


13. 


Convert the given є - МЕА 


14. Show that regular languages are closed under intersection and reversal. 
15. Constructan e - NFA for the regular expression over X = (0, 1) given by (0 + 11)0*1 
16. Check whether the given grammar is ambiguous or not 
5 2S«S|SxS|a|b 
17. Write short note on chomskey hierachy of languages. 
18. Convert the following CFG to PDA 
S — aABC 
5 — aB|a 
S — bA|b 
5 эа 
19. Eliminate left recursion from the following productions 
E -Б+Т|Т 
T —TxF|F 
Е > (E) | id 
20. Show that the complement of a recursive language is recursive 
Answer any three questions. Each question carries 15 marks. Зх 15 =45 
21. 
а. Drawa DFA to accept strings of a's and b's having even number of a's and even number 
of b's. 7 
b. Prove that if there exists NFA M, which accepts the language L(M,), there exists an 


equivalent DFA such that L(M,) = L(M,) 
N 


Model Question Pape 


22. 
a. State and prove pumping lemma for regular languages. 8 
b. Prove that = (a" b" | n> 1) is not regular 

23. Define equivalent states and reduce the 10 
a. DFA given below 


Q a b 
+ 1 3 2 
2 4 1 
3 5 4 
4 4 4 
*- 5 3 2 
b. Compare DFA, NFA and e - NFA 5 
24. Design a push down automa to accept the language 
L = (wcw | w(e(a + b)*) and check whether it is deterministic (1045) 
25. Simplify the following CFG 10 
(a) S —aA |a|B|c 
А —aB|e 
В aA 
С > ccD 
D > abd 
(b) Describe the types of turing machine. 5 
Sec 
Answer any One 1x1=10 
26. Convert the following CFG to GNF 
S —AA|0 
А >55 |1 
27. 
а. Describe post correspondence problem. 5 


b. Construct a CFG to generate the set of all palindromes defined over (0, 1) 
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of Computation 
MODEL QUESTION PAPER 2 


VI Semester BCA Degree Examination 
(CBCS) (16-17 and onwards) 


Computer Science 
BCA 601Т : Theory of Computation 
Time 3 Hrs. Max. Marks : 100 
Answer any ten questions. Each carries two marks 10x2=20 


1. Define Symbol, Alphabet 

. Write the five tuples of FA 

. Design a DFA which ends with 01 

. Define є - closure 

- Write the regular expression for a followed by zero or more number of a's and b's. 
. Define regular expression. 

. Define ID of a PDA 


. Explain nullable variable with an example. 
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- Define recursively enumerable language 


m 
e 


. Write any four types of turing machine. 


m 
аҹ 


. List the properties of CFG. 
. Define CNF. 


н 
ко 


Section B 


Answer any fine questions. Each carries 5 marks 5x5=25 
13. Differentiate between DFA, NFA and є - NFA 
14. Convert the following NFA to DFA 


15. Covert the following regular expression to є - NFA 
(a + b)* ab (a + b)* 


Model Question Papers 


. Obtain the string aaabbabbba by applying left most and rightmost derivation. 
Construct a parsetree from the following grammar 


S —aB | bA 
А > aS|bAA |a 
B — bS | aBB | b 
‚ 17. Define TM and language accepted by a TM 
© 18. Prove that the union of recursively enumerable language is recursively enumerable. 
19. Eliminate left recursion from the given grammar 
5 —Ab|a 
A — Ab | Sa 
20. Write the general steps to covert CFG to PDA 


Answer any three. Each carries 15 marks 15x3=45 
23. 
a. Prove that following language is not regular Г = (0" | n is prime} 5 
b. Minimize the following grammar 10 
8 0 1 
А B E 
B C F 
* 0 D H 
D E H 
E E I 
d G B 
G H B 
H I c 
ET A E 
22. 
a. Define parsing, parse tree, leftmost derivation and rightmost derivation. 8 
b. Draw a DFA to accept strings of a's and b's ending with abb 7 
28; 


a. Simplify the following grammar 8 


umum 


S эада 

А — Sb | bcc | ард 
C — ab |aD 

Е —ac 

D —aAD 


b. Write the steps to eliminate useless symbols. 


24. 


a. Construct a PDA to accept the language L = (a" b” | п> 1) 


b. Convert the following CFG to PDA 


S — aABC 

А —aB|a 

B — bA|b 

Ca 
25. 


а. Constructa TM to accept the language 


= {а" "|п>1} 


b. Prove that if L and L1 are both recursively enumerable, 


then L and L are recursive. 


Sec 


Answer any one. Each carries 10 Marks. 


26. 
a. Draw a DFA to accept the langua 


27. 
a. Define CNF $ 
9. 
b. Convert the following CF © 
S — 0A/1B/ 
АОАА [ 15/1 
B1BB/0S/0 
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